Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

Multimodal InteractionModule description #40586 / Version 8

← Module page Deutsche Fassung
Module / Version#40586 / #8
ValiditySince Summer semester 2022
Available language(s)English
Credit points6
Person responsible for the moduleMöller, Sebastian
GradingGraded
Exam formatPortfolio examination
Language(s) of instructionEnglish

Affiliation

FacultyFakultät IV
InstituteInstitut für Softwaretechnik und Theoretische Informatik
Academic chair34355300 FG S-Professur Quality and Usability

Contact

OfficeMAR 6-7
Contact personJettkowski, Tobias
E-mail addressmodule@qu.tu-berlin.de
Websitehttps://tu.berlin/qu

Learning outcomes

- understanding of “Multimodal Human-Computer Interaction” as interdisciplinary research and application field during the development of information and communication technologies
- knowledge of the realisation of human-computer interfaces
- application of this knowledge in the design cycle of technical systems
- hands-on practicing of the learned skills evaluating the quality and usability of selected technical systems
- presenting and transferring the learned skills to others

Content

"Multimodal Interaction" (IV)
In this course, we will set the basics for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We will start with clarifying the basic principles of human-human communication and human-machine interaction. We will then describe the processes taking place in humans when perceiving auditory, visual and tactile signals, as well as how these perceptions are integrated in order to form a multimodal perception. The signals can be generated and received by machines which are able to interact with humans in limited domains. The set-up of such machines will be discussed, and limitations as well as potential solutions to overcome these limitations will be explained.

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
Multimodal InteractionIntegrated course Summer semester–4 ISIS

Workload and credit points

Multimodal Interaction (Integrated course)

Workload descriptionMultiplierHoursTotal
Preparation and follow-up of additional material, including homework and project158 h120 h
Watching lecture videos and preparing for the lecture.154 h60 h
180 h

The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.

Description of teaching and learning methods

The module is organized as an interactive online course.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

Basic knowledge of information and communication technologies, including basic programming skills.

Mandatory requirements for the module examination registration:

This module has no examination requirements.

Completion of the module

GradingGraded
Exam formatPortfolio examination
Type of portfolio examination100 points in total
LanguageEnglish

Test elements

NamePoints/WeightCategoryDuration/Extent
(Deliverable assessment) Homework with 5 tasks and project work with 4 tasks (40 points)40practical40 h
(Examination) Digital test (1)30written45 min
(Examination) Digital test (2)30written45 min

Exam description

Portfolio examination: The content of the lecture Multimodal Interaction is examined up to the time of the respective examination date. For this purpose, two digital exams are carried out in the semester. Homeworks: 5 short written homework tasks have to be written and submitted. Project work: A multimodal app has to be programmed, which is implemented in four successive sections. The project result must be submitted, and the final result must be presented.

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Summer semester.

Maximum number of participants

The maximum capacity of participants is 150.

Registration procedures

The registration takes place via ISIS. The exam registration takes place at the examination office or via QISPOS.

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

available – Can be downloaded from ISIS page of the corresponding courses.

Recommended literature

  • Recommended literature will be announced in the course.

Assigned programs

This module version is used in the following programs:

Program / program versionSemester(s)Curriculum component
Computer Engineering
Computer Engineering (B. Sc.) - StuPO 2015
SS 2025Wahlpflichtbereich › Medientechnik
WS 2025/26Wahlpflichtbereich › Medientechnik
SS 2026Wahlpflichtbereich › Medientechnik
WS 2026/27Wahlpflichtbereich › Kataloge › Medientechnik
Computer Engineering
Computer Engineering (M. Sc.) - StuPO 2015
SS 2025Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2025/26Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems
SS 2026Wahlpflicht Studiengebiet B › Medientechnik und Mensch-Maschine-Interaktion / Digital Media und Human-Computer Interaction
WS 2026/27Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems
Computer Science
Computer Science (B. Sc.) - StuPO 2015
SS 2025Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik
WS 2025/26Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik
SS 2026Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik
WS 2026/27Wahlpflichtbereich › Katalog Informatik
Computer Science
Computer Science (B. Sc.) - StuPO 2025
WS 2026/27Wahlpflichtbereich › Informatiknahe Bereiche › Anwendungsnahe Informatik
Computer Science (Informatik)
Computer Science (Informatik) (M. Sc.) - StuPO 2015
SS 2025Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2025/26Studiengebiete › Kognitive Systeme / Cognitive Systems
SS 2026Studiengebiete › Kognitive Systeme / Cognitive Systems
WS 2026/27Wahlpflichtbereich › Studiengebiet › Kognitive Systeme / Cognitive Systems
Digital Media and Technology
Digital Media and Technology (M. Sc.) - StuPO 2017
SS 2025Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Audio und Sprache
WS 2025/26Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Audio und Sprache
SS 2026Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Mensch-Maschine-Interaktion
WS 2026/27Wahlpflichtbereich › Technische Profilbereiche (A) › Mensch-Maschine-Interaktion
Electrical Engineering
Electrical Engineering (M. Sc.) - StuPO 2015
SS 2025Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2025/26Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
SS 2026Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2026/27Wahlpflichtbereich › Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
Industrial Engineering and Management
Industrial Engineering and Management (M. Sc.) - StuPO 2015
SS 2022Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems
WS 2022/23Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems
SS 2023Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction
WS 2023/24Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction
SS 2024Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction
WS 2024/25Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction
SS 2025Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems
WS 2025/26Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems
SS 2026Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems
WS 2026/27Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems
Industrial Engineering and Management
Industrial Engineering and Management (M. Sc.) - StuPO 2026
WS 2026/27Engineering Sciences / Specialization › AI Engineering › Cognitive Systems
Information Systems Management
Information Systems Management (B. Sc.) - StuPO 2015
SS 2025Wahlpflichtbereich › Informatik
WS 2025/26Wahlpflichtbereich › Informatik
SS 2026Wahlpflichtbereich › Informatik
WS 2026/27Wahlpflichtbereich › Informatik
Information Systems Management
Information Systems Management (B. Sc.) - StuPO 2021
SS 2025Wahlpflichtbereich › Informatik
WS 2025/26Wahlpflichtbereich › Informatik
SS 2026Wahlpflichtbereich › Informatik
WS 2026/27Wahlpflichtbereich › Informatik
Information Systems Management (Wirtschaftsinformatik)
Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017
SS 2025Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems
WS 2025/26Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems
SS 2026Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems
WS 2026/27Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems
Language and Communication
Language and Communication (M. A.) - PO 2015
SS 2025Wahlpflicht Vertiefung
WS 2025/26Wahlpflicht Vertiefung
SS 2026Wahlpflicht Vertiefung
WS 2026/27Wahlpflicht Vertiefung
Media Technology
Media Technology (B. Sc.) - StuPO 2018
SS 2025Wahlpflichtbereich › Mensch-Maschine-Interaktion
WS 2025/26Wahlpflichtbereich › Mensch-Maschine-Interaktion
SS 2026Wahlpflichtbereich › Katalog Medientechnik
WS 2026/27Wahlpflichtbereich › Katalog Medientechnik
Media Technology
Media Technology (M. Sc.) - StuPO 2022
SS 2025Wahlpflicht weitere Profibereiche › weiterer Profilbereich Audio und Sprache
WS 2025/26Wahlpflicht weitere Profibereiche › weiterer Profilbereich Audio und Sprache
SS 2026Wahlpflicht weitere Profibereiche › weiterer Profilbereich Audio und Sprache
WS 2026/27Wahlpflichtbereich › weitere Profibereiche › Audio und Sprache
Sprache und Kommunikation
StuPO 2025
WS 2026/27Wahlpflichtbereich Vertiefung › Quality and Usability
Technomathematics
Technomathematics (M. Sc.) - StuPO 2014
SS 2025Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET
WS 2025/26Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET
SS 2026Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET
WS 2026/27Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET

Miscellaneous

The topics of the module can serve as a foundation of a master thesis in the area.