Event-based Robot VisionModule description #40993 / Version 2
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- English
| Module / Version | #40993 / #2 |
|---|---|
| Validity | Since Summer semester 2025 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Gallego, Guillermo |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Technische Informatik und Mikroelektronik |
| Academic chair | 34342000 FG Robotic Interactive Perception |
Contact
| Office | MAR 5-5 |
|---|---|
| Contact person | Gallego, Guillermo |
| E-mail address | guillermo.gallego@tu-berlin.de |
| Website | https://www.digital-future.berlin/en/about-us/professors/prof-dr-guillermo-gallego/ |
Learning outcomes
Participants will learn basic concepts, theoretical foundations and relevant algorithms developed in the field of event-based (i.e., neuromorphic) vision. Upon completing the module, participants will have an overview of the field, spanning from the principle of operation of event-based sensors (e.g., event-based cameras), their advantages and disadvantages, to the methods used to process their output for a target application. Participants will also be aware of the differences with standard (frame-based) computer vision, in terms of methods, performance criteria and applications.
Content
This course is the first of its kind, worldwide. To the best of the instructor's knowledge, no similar course has been offered anywhere due to the novelty of the topics covered, which have appeared in research conferences and journals over the last ten years.
The topics covered include the following:
Bio-inspired principle of operation of event-based (i.e., neuromorphic) sensors.
Event-based feature detection and tracking.
Event-based motion estimation: optical flow estimation, 3D reconstruction, camera localization and ego-motion estimation, simultaneous localization and mapping (E-SLAM).
Stereo depth estimation in dynamic scenes.
Image intensity reconstruction from events.
Event-based pattern recognition, classification and machine learning.
Event-based signal processing and filtering.
Event-based sensor fusion.
Event-based control.
Event-based (i.e., spike-based) hardware.
Novel applications in event-based vision.
The topics covered include the following:
Bio-inspired principle of operation of event-based (i.e., neuromorphic) sensors.
Event-based feature detection and tracking.
Event-based motion estimation: optical flow estimation, 3D reconstruction, camera localization and ego-motion estimation, simultaneous localization and mapping (E-SLAM).
Stereo depth estimation in dynamic scenes.
Image intensity reconstruction from events.
Event-based pattern recognition, classification and machine learning.
Event-based signal processing and filtering.
Event-based sensor fusion.
Event-based control.
Event-based (i.e., spike-based) hardware.
Novel applications in event-based vision.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Event-based Robot Vision | Exercise | 34342000L-002 | Summer semester | [en] | 2 | WS 2026/27 (1) ISIS |
| Event-based Robot Vision | Lecture | 34342000L-001 | Summer semester | [en] | 4 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (2)
Event-based Robot Vision (Exercise) 1
- Event-based Robot Vision (Übung) Termingruppe 1 3434 L 002
Event-based Robot Vision (Lecture) 1
- Event-based Robot Vision (Vorlesung) Termingruppe 1 3434 L 001
Workload and credit points
Event-based Robot Vision (Exercise)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
Event-based Robot Vision (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 4 h | 60 h |
| Pre/post processing | 15 | 2 h | 30 h |
| 90 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
The lectures will present the topics (sensors and algorithms) from a theoretical point of view, highlighting the underlying principles and mathematical tools used. Participation/interaction is encouraged and expected, including the possibility of reading assignments. Participants are expected to rehearse topics after class in preparation for the exercises.
The exercises take place in parallel. They offer the participants the opportunity to get practical insights about the technology of event-based cameras. Event-based processing algorithms will be discussed in detail and partially implemented.
The exercises take place in parallel. They offer the participants the opportunity to get practical insights about the technology of event-based cameras. Event-based processing algorithms will be discussed in detail and partially implemented.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
The module covers many topics at the forefront of research. It requires a basic knowledge of information technology, image processing, computer vision and machine learning.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Examination) Written test (final) | 40 | written | 60 minutes |
| (Examination) Written test (midterm) | 30 | written | 60 minutes |
| (Deliverables) Practice exercises | 30 | practical | 2-4 pages, program code |
Exam description
The exams consists of multiple choice questions as well as problems where the answer needs to be worked out in written form (with sentences and mathematics).
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
For any questions about the module, please contact Prof. Gallego
guillermo.gallego@tu-berlin.de
guillermo.gallego@tu-berlin.de
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Gallego et al., Event-based Vision: A survey, IEEE T-PAMI 2022. https://arxiv.org/abs/1904.08405
- Posch et al., Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output. Proc. IEEE (2014), 102(10):1470-1484
- List of Event-based Vision Resources: https://github.com/uzh-rpg/event-based_vision_resources
- CVPR 2023 International Workshop on Event-based Vision - Slides and Videos: https://tub-rip.github.io/eventvision2023/
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Kognitive Systeme / Cognitive Systems | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Cognitive Systems |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
Miscellaneous
Mastermodul:
Kognitive Systeme und Informationssysteme
Kognitive Systeme und Informationssysteme