Multimodal InteractionModule description #40586 / Version 7
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- German
This module description is not valid in the current semester (Winter semester 2026/27).
Current version (v8)
| Module / Version | #40586 / #7 |
|---|---|
| Validity | SS 2018 – Winter semester 2021/22 |
| Available language(s) | German |
| Credit points | 6 |
| Person responsible for the module | Möller, Sebastian |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | German |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34355300 FG S-Professur Quality and Usability |
Contact
| Office | MAR 6-7 |
|---|---|
| Contact person | Jettkowski, Tobias |
| E-mail address | module@qu.tu-berlin.de |
| Website | https://tu.berlin/qu |
Learning outcomes
Students gain:
- Understanding of “Usabiliy” as interdisciplinary research and application field during the development of information and communication technologies
- Knowledge of the realisation of human-computer interfaces
- Application of this knowledge in the design cycle of technical systems
- Hands-on practicing of the learned skills evaluating the quality and usability of selected technical systems.
- Presenting and transferring the learned skills to others
- Understanding of “Usabiliy” as interdisciplinary research and application field during the development of information and communication technologies
- Knowledge of the realisation of human-computer interfaces
- Application of this knowledge in the design cycle of technical systems
- Hands-on practicing of the learned skills evaluating the quality and usability of selected technical systems.
- Presenting and transferring the learned skills to others
Content
IV “Multimodal Interaction”
In this seminar we will set the basics for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We will start with clarifying the basic principles of human-human communication and human-machine interaction. We will then describe the processes taking place in humans when perceiving auditory, visual and tactile signals, as well as how these perceptions are integrated in order to form a multimodal perception. The signals can be generated and received by machines which are able to interact with humans in limited domains. The set-up of such machines will be discussed, and limitations as well as potential solutions to overcome these limitations will be explained.
In this seminar we will set the basics for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We will start with clarifying the basic principles of human-human communication and human-machine interaction. We will then describe the processes taking place in humans when perceiving auditory, visual and tactile signals, as well as how these perceptions are integrated in order to form a multimodal perception. The signals can be generated and received by machines which are able to interact with humans in limited domains. The set-up of such machines will be discussed, and limitations as well as potential solutions to overcome these limitations will be explained.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Multimodal Interaction | Integrated course | Summer semester | – | 4 | ISIS |
Workload and credit points
Multimodal Interaction (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Präsenzzeit | 15 | 4 h | 60 h |
| Vor-/Nachbereitung | 15 | 8 h | 120 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
Literature work and written elaborations under guidance; talk and discussion in the plenum
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Basic knowledge of information and communication technologies
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English, German |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Ergebnisprüfung) 4 Programmier-Hausaufgaben je 10 Stunden à 10 Punkte | 40 | practical | 40 Stunden |
| (Punktuelle Leistungsabfrage) 2 schriftliche Prüfungen je 45 min à 30 Punkte | 60 | flexibel | 90 min |
Exam description
Schriftliche Prüfungen: Geprüft wird der Inhalt der Vorlesung Multimodale Interaktion bis zum Zeitpunkt des jeweiligen Prüfungstermins. Dazu werden im Semester zwei schriftliche Prüfungen zu je 45 Minuten durchgeführt.
Programmier-Hausaufgabe: Es muss eine multimodale App programmiert werden, die in vier aufeinander aufbauenden Abschnitten implementiert wird. Das Ergebnis (Code und Binary) jeden Abschnitts muss als Hauaufgabe abgegeben werden. Nach der Abgabefrist wird jeweils eine Musterlösung zur Verfügung gestellt.
Programmier-Hausaufgabe: Es muss eine multimodale App programmiert werden, die in vier aufeinander aufbauenden Abschnitten implementiert wird. Das Ergebnis (Code und Binary) jeden Abschnitts muss als Hauaufgabe abgegeben werden. Nach der Abgabefrist wird jeweils eine Musterlösung zur Verfügung gestellt.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
Registration for the seminar in the first course meeting
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – Can be downloaded from ISIS page of the corresponding courses.
Recommended literature
- Literature for the seminar will be announced in the course.
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2020 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction |
| WS 2020/21 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction | |
| SS 2021 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction | |
| WS 2021/22 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction |
- Master Technische Informatik: Technische Anwendungen
- Master Wirtschaftsingenieurwesen: Informations- und Kommunikationssysteme
- Master Audiokommunikation und -technologie
- Master Wirtschaftsingenieurwesen: Informations- und Kommunikationssysteme
- Master Audiokommunikation und -technologie
Miscellaneous
The topics of the module can serve as a foundation of a master thesis in the area.