Multimodal InteractionModule description #40586 / Version 8
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- English
| Module / Version | #40586 / #8 |
|---|---|
| Validity | Since Summer semester 2022 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Möller, Sebastian |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34355300 FG S-Professur Quality and Usability |
Contact
| Office | MAR 6-7 |
|---|---|
| Contact person | Jettkowski, Tobias |
| E-mail address | module@qu.tu-berlin.de |
| Website | https://tu.berlin/qu |
Learning outcomes
- understanding of “Multimodal Human-Computer Interaction” as interdisciplinary research and application field during the development of information and communication technologies
- knowledge of the realisation of human-computer interfaces
- application of this knowledge in the design cycle of technical systems
- hands-on practicing of the learned skills evaluating the quality and usability of selected technical systems
- presenting and transferring the learned skills to others
- knowledge of the realisation of human-computer interfaces
- application of this knowledge in the design cycle of technical systems
- hands-on practicing of the learned skills evaluating the quality and usability of selected technical systems
- presenting and transferring the learned skills to others
Content
"Multimodal Interaction" (IV)
In this course, we will set the basics for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We will start with clarifying the basic principles of human-human communication and human-machine interaction. We will then describe the processes taking place in humans when perceiving auditory, visual and tactile signals, as well as how these perceptions are integrated in order to form a multimodal perception. The signals can be generated and received by machines which are able to interact with humans in limited domains. The set-up of such machines will be discussed, and limitations as well as potential solutions to overcome these limitations will be explained.
In this course, we will set the basics for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We will start with clarifying the basic principles of human-human communication and human-machine interaction. We will then describe the processes taking place in humans when perceiving auditory, visual and tactile signals, as well as how these perceptions are integrated in order to form a multimodal perception. The signals can be generated and received by machines which are able to interact with humans in limited domains. The set-up of such machines will be discussed, and limitations as well as potential solutions to overcome these limitations will be explained.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Multimodal Interaction | Integrated course | Summer semester | – | 4 | ISIS |
Workload and credit points
Multimodal Interaction (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Preparation and follow-up of additional material, including homework and project | 15 | 8 h | 120 h |
| Watching lecture videos and preparing for the lecture. | 15 | 4 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
The module is organized as an interactive online course.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Basic knowledge of information and communication technologies, including basic programming skills.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Homework with 5 tasks and project work with 4 tasks (40 points) | 40 | practical | 40 h |
| (Examination) Digital test (1) | 30 | written | 45 min |
| (Examination) Digital test (2) | 30 | written | 45 min |
Exam description
Portfolio examination: The content of the lecture Multimodal Interaction is examined up to the time of the respective examination date. For this purpose, two digital exams are carried out in the semester. Homeworks: 5 short written homework tasks have to be written and submitted. Project work: A multimodal app has to be programmed, which is implemented in four successive sections. The project result must be submitted, and the final result must be presented.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 150.
Registration procedures
The registration takes place via ISIS. The exam registration takes place at the examination office or via QISPOS.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – Can be downloaded from ISIS page of the corresponding courses.
Recommended literature
- Recommended literature will be announced in the course.
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (B. Sc.) - StuPO 2015 | SS 2025 | Wahlpflichtbereich › Medientechnik |
| WS 2025/26 | Wahlpflichtbereich › Medientechnik | |
| SS 2026 | Wahlpflichtbereich › Medientechnik | |
| WS 2026/27 | Wahlpflichtbereich › Kataloge › Medientechnik | |
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Wahlpflicht Studiengebiet B › Medientechnik und Mensch-Maschine-Interaktion / Digital Media und Human-Computer Interaction | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| Computer Science Computer Science (B. Sc.) - StuPO 2015 | SS 2025 | Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik |
| WS 2025/26 | Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik | |
| SS 2026 | Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik | |
| WS 2026/27 | Wahlpflichtbereich › Katalog Informatik | |
| Computer Science Computer Science (B. Sc.) - StuPO 2025 | WS 2026/27 | Wahlpflichtbereich › Informatiknahe Bereiche › Anwendungsnahe Informatik |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2025/26 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Kognitive Systeme / Cognitive Systems | |
| Digital Media and Technology Digital Media and Technology (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Audio und Sprache |
| WS 2025/26 | Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Audio und Sprache | |
| SS 2026 | Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Mensch-Maschine-Interaktion | |
| WS 2026/27 | Wahlpflichtbereich › Technische Profilbereiche (A) › Mensch-Maschine-Interaktion | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2022 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems |
| WS 2022/23 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems | |
| SS 2023 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction | |
| WS 2023/24 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction | |
| SS 2024 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction | |
| WS 2024/25 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Digital Media und Human-Computer Interaction | |
| SS 2025 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems | |
| WS 2025/26 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems | |
| SS 2026 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems | |
| WS 2026/27 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Cognitive Systems |
| Information Systems Management Information Systems Management (B. Sc.) - StuPO 2015 | SS 2025 | Wahlpflichtbereich › Informatik |
| WS 2025/26 | Wahlpflichtbereich › Informatik | |
| SS 2026 | Wahlpflichtbereich › Informatik | |
| WS 2026/27 | Wahlpflichtbereich › Informatik | |
| Information Systems Management Information Systems Management (B. Sc.) - StuPO 2021 | SS 2025 | Wahlpflichtbereich › Informatik |
| WS 2025/26 | Wahlpflichtbereich › Informatik | |
| SS 2026 | Wahlpflichtbereich › Informatik | |
| WS 2026/27 | Wahlpflichtbereich › Informatik | |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| Language and Communication Language and Communication (M. A.) - PO 2015 | SS 2025 | Wahlpflicht Vertiefung |
| WS 2025/26 | Wahlpflicht Vertiefung | |
| SS 2026 | Wahlpflicht Vertiefung | |
| WS 2026/27 | Wahlpflicht Vertiefung | |
| Media Technology Media Technology (B. Sc.) - StuPO 2018 | SS 2025 | Wahlpflichtbereich › Mensch-Maschine-Interaktion |
| WS 2025/26 | Wahlpflichtbereich › Mensch-Maschine-Interaktion | |
| SS 2026 | Wahlpflichtbereich › Katalog Medientechnik | |
| WS 2026/27 | Wahlpflichtbereich › Katalog Medientechnik | |
| Media Technology Media Technology (M. Sc.) - StuPO 2022 | SS 2025 | Wahlpflicht weitere Profibereiche › weiterer Profilbereich Audio und Sprache |
| WS 2025/26 | Wahlpflicht weitere Profibereiche › weiterer Profilbereich Audio und Sprache | |
| SS 2026 | Wahlpflicht weitere Profibereiche › weiterer Profilbereich Audio und Sprache | |
| WS 2026/27 | Wahlpflichtbereich › weitere Profibereiche › Audio und Sprache | |
| Sprache und Kommunikation StuPO 2025 | WS 2026/27 | Wahlpflichtbereich Vertiefung › Quality and Usability |
| Technomathematics Technomathematics (M. Sc.) - StuPO 2014 | SS 2025 | Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET |
| WS 2025/26 | Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET | |
| SS 2026 | Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET | |
| WS 2026/27 | Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET |
Miscellaneous
The topics of the module can serve as a foundation of a master thesis in the area.