Event-based Robot VisionModulbeschreibung #40993 / Version 1
- 6 LP
- Portfolioprüfung
- Benotet
- Sommersemester
- Englisch
Diese Modulbeschreibung gilt nicht im aktuellen Semester (WiSe 2026/27).
Zur aktuellen Version (v2)
| Modul / Version | #40993 / #1 |
|---|---|
| Gültigkeit | SoSe 2020 – WiSe 2024/25 |
| Verfügbare Sprache(n) | Englisch |
| Leistungspunkte | 6 |
| Modulverantwortliche*r | Gallego, Guillermo |
| Benotung | Benotet |
| Prüfungsform | Portfolioprüfung |
| Lehrsprache(n) | Englisch |
Zugehörigkeit
| Fakultät | Fakultät IV |
|---|---|
| Institut | Institut für Technische Informatik und Mikroelektronik |
| Fachgebiet | 34342000 FG Robotic Interactive Perception |
Kontakt
| Sekretariat | MAR 5-5 |
|---|---|
| Ansprechpartner*in | Gallego, Guillermo |
| E-Mail-Adresse | guillermo.gallego@tu-berlin.de |
| Webseite | https://www.digital-future.berlin/en/about-us/professors/prof-dr-guillermo-gallego/ |
Lernergebnisse
Participants will learn basic concepts, theoretical foundations and relevant algorithms developed in the field of event-based (i.e., neuromorphic) vision. Upon completing the module, participants will have an overview of the field, spanning from the principle of operation of event-based sensors (e.g., event-based cameras), their advantages and disadvantages, to the methods used to process their output for a target application. Participants will also be aware of the differences with standard (frame-based) computer vision, in terms of methods, performance criteria and applications.
Lehrinhalte
This course is the first of its kind, worldwide. To the best of the instructor's knowledge, no similar course has been offered anywhere due to the novelty of the topics covered, which have appeared in research conferences and journals over the last ten years.
The topics covered include the following:
Bio-inspired principle of operation of event-based (i.e., neuromorphic) sensors.
Event-based feature detection and tracking.
Event-based motion estimation: optical flow estimation, 3D reconstruction, camera localization and ego-motion estimation, simultaneous localization and mapping (E-SLAM).
Stereo depth estimation in dynamic scenes.
Image intensity reconstruction from events.
Event-based pattern recognition, classification and machine learning.
Event-based signal processing and filtering.
Event-based sensor fusion.
Event-based control.
Event-based (i.e., spike-based) hardware.
Novel applications in event-based vision.
The topics covered include the following:
Bio-inspired principle of operation of event-based (i.e., neuromorphic) sensors.
Event-based feature detection and tracking.
Event-based motion estimation: optical flow estimation, 3D reconstruction, camera localization and ego-motion estimation, simultaneous localization and mapping (E-SLAM).
Stereo depth estimation in dynamic scenes.
Image intensity reconstruction from events.
Event-based pattern recognition, classification and machine learning.
Event-based signal processing and filtering.
Event-based sensor fusion.
Event-based control.
Event-based (i.e., spike-based) hardware.
Novel applications in event-based vision.
Modulbestandteile
Pflichtbereich
Die folgenden Veranstaltungen sind für das Modul obligatorisch:
| Lehrveranstaltungen | Art | Nummer | Turnus | Sprache | SWS | VVZ |
|---|---|---|---|---|---|---|
| Event-based Robot Vision | Übung | 34342000L-002 | Sommersemester | [en] | 2 | WiSe 2026/27 (1) ISIS |
| Event-based Robot Vision | Vorlesung | 34342000L-001 | Sommersemester | [en] | 4 | WiSe 2026/27 (1) ISIS |
Veranstaltungen im Vorlesungsverzeichnis
Veranstaltungen, die aus den Lehrveranstaltungen dieses Moduls angelegt wurden.
WiSe 2026/27 (2)
Event-based Robot Vision (Übung) 1
- Event-based Robot Vision (Übung) Termingruppe 1 3434 L 002
Event-based Robot Vision (Vorlesung) 1
- Event-based Robot Vision (Vorlesung) Termingruppe 1 3434 L 001
Arbeitsaufwand und Leistungspunkte
Event-based Robot Vision (Übung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Event-based Robot Vision (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 4 h | 60 h |
| Vor-/Nachbereitung | 15 | 2 h | 30 h |
| 90 h | |||
Der Aufwand des Moduls summiert sich zu 180 Stunden. Damit umfasst das Modul 6 Leistungspunkte.
Beschreibung der Lehr- und Lernformen
The lectures will present the topics (sensors and algorithms) from a theoretical point of view, highlighting the underlying principles and mathematical tools used. Participation/interaction is encouraged and expected, including the possibility of reading assignments. Participants are expected to rehearse topics after class in preparation for the exercises.
The exercises take place in parallel. They offer the participants the opportunity to get practical insights about the technology of event-based cameras. Simple event-based processing algorithms will be discussed in detail and partially implemented.
The exercises take place in parallel. They offer the participants the opportunity to get practical insights about the technology of event-based cameras. Simple event-based processing algorithms will be discussed in detail and partially implemented.
Voraussetzungen für die Teilnahme / Prüfung
Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:
The module covers many topics at the forefront of research. It requires a basic knowledge of information technology, image processing, computer vision and machine learning.
Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:
Dieses Modul hat keine Prüfungsvoraussetzungen.
Abschluss des Moduls
| Benotung | Benotet |
|---|---|
| Prüfungsform | Portfolioprüfung |
| Art der Portfolioprüfung | 100 Punkte insgesamt |
| Sprache | Englisch |
Prüfungselemente
| Name | Punkte/Gewicht | Kategorie | Dauer/Umfang |
|---|---|---|---|
| (Examination) Written test | 40 | schriftlich | 75 minutes |
| (Examination) Written test 2 | 30 | schriftlich | 75 minutes |
| (Deliverables) Practice exercises | 30 | praktisch | 2-4 pages, program code |
Dauer des Moduls
Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt: 1 Semester.
Dieses Modul kann in folgenden Semestern begonnen werden: Sommersemester.
Maximale teilnehmende Personen
Die maximale Teilnehmerzahl beträgt 30.
Anmeldeformalitäten
For any questions about the module, contact Prof. Gallego
guillermo.gallego@tu-berlin.de
guillermo.gallego@tu-berlin.de
Literaturhinweise, Skripte
Skript in Papierform
nicht verfügbar
Skript in elektronischer Form
nicht verfügbar
Empfohlene Literatur
- Gallego et al., Event-based Vision: A survey, 2019. https://arxiv.org/abs/1904.08405
- Posch et al., Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output. Proc. IEEE (2014), 102(10):1470-1484
- List of Event-based Vision Resources: https://github.com/uzh-rpg/event-based_vision_resources
- CVPR 2019 Second International Workshop on Event-based Vision and Smart Cameras - Slides and Videos: http://rpg.ifi.uzh.ch/CVPR19_event_vision_workshop.html
- ICRA 2017 First International Workshop on Event-based Vision - Slides and Videos: http://rpg.ifi.uzh.ch/ICRA17_event_vision_workshop.html
Zugeordnete Studiengänge
Dieses Modul findet in keinem Studiengang Verwendung.
Sonstiges
Mastermodul:
Kognitive Systeme und Informationssysteme
Kognitive Systeme und Informationssysteme