Recent Trends in Deep Learning for Computer VisionModule description #41089 / Version 1
- 3 CP
- Portfolio examination
- Graded
- Summer semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
| Module / Version | #41089 / #1 |
|---|---|
| Validity | Summer semester 2023 – Winter semester 2025/26 |
| Available language(s) | English |
| Credit points | 3 |
| Person responsible for the module | Demir, Begüm |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Technische Informatik und Mikroelektronik |
| Academic chair | 34342200 FG Remote Sensing Image Analysis (RSiM) |
Contact
| Office | EN 5 |
|---|---|
| Contact person | Witte, Bethany Jane |
| E-mail address | b.witte@tu-berlin.de |
| Website | https://rsim.berlin/ |
Learning outcomes
Participants of this seminar acquire advanced knowledge in the field of deep learning for computer vision. After completing this course, the students are capable of conducting a literature search, contextualizing scientific papers and presenting topics drawn from the deep learning and computer vision literature. Moreover, students participate in scientific discussions and have an opportunity to sharpen their critical thinking skills.
Content
The seminar aims to deepen the understanding of the participants in current research problems at the intersection of deep learning and computer vision. The topics include, yet are not limited to:
- The evolution of CNN architectures (depth, layer composition, activation functions, drop out);
- Vision transformers (attention mechanism, basic and advanced architectures);
- Data augmentation techniques (basic techniques, MixUp, CutOut, AutoAug, RandAug, etc.);
- Semi-supervised learning (temporal ensembling, mean teacher, co-teaching, consistency loss and pseudo-labeling, MixMatch, ReMixMatch, etc.);
- Self-supervised learning (foundations of representation learning, pre-text tasks, contrastive loss, triplet loss, SimCLR, BYOL, SimSiam, etc.);
- Diffusion Models and Dall-E 2 (current breakthroughs in fusion of semantics of text and image, generative modeling);
- Explainable AI (clever hans phenomena, backprogation based method, gradient-based methods);
- Optimization theory of neural networks;
- Learning and generalization theory of neural networks (shortcut learning, forgetting/memorization events, layer importance, sample difficulty, learning paths, learning bias in texture/shape).
- The evolution of CNN architectures (depth, layer composition, activation functions, drop out);
- Vision transformers (attention mechanism, basic and advanced architectures);
- Data augmentation techniques (basic techniques, MixUp, CutOut, AutoAug, RandAug, etc.);
- Semi-supervised learning (temporal ensembling, mean teacher, co-teaching, consistency loss and pseudo-labeling, MixMatch, ReMixMatch, etc.);
- Self-supervised learning (foundations of representation learning, pre-text tasks, contrastive loss, triplet loss, SimCLR, BYOL, SimSiam, etc.);
- Diffusion Models and Dall-E 2 (current breakthroughs in fusion of semantics of text and image, generative modeling);
- Explainable AI (clever hans phenomena, backprogation based method, gradient-based methods);
- Optimization theory of neural networks;
- Learning and generalization theory of neural networks (shortcut learning, forgetting/memorization events, layer importance, sample difficulty, learning paths, learning bias in texture/shape).
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Recent Trends in Deep Learning for Computer Vision | Seminar | Summer semester | [en] | 2 | ISIS |
Workload and credit points
Recent Trends in Deep Learning for Computer Vision (Seminar)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
The workload of the module adds up to 90 hours. The module therefore comprises 3 credit points.
Description of teaching and learning methods
At the beginning of the semester, there will be an overview lecture that will serve as an introduction to the current research problems in deep learning and computer vision. In addition, a set of primary literature works will be provided to assist the students to choose their topic. A follow-up lecture will guide the students through the process of how to work with scientific papers and write a scientific report. Then, the students will independently investigate the topics assigned to them and prepare a presentation. For the remaining part of the semester, each class will cover one of the course topics. Two students assigned to one topic will give a presentation of approximately 40 minutes (20 minutes each) that will be followed by a group discussion with all participants of the seminar. In addition to the talk, the students will also prepare a scientific report on their topic of approximately 10-15 pages.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Good knowledge in Mathematics, especially linear algebra and statistics, are required. The courses Machine Learning I and Machine Learning II or an equivalent should have been completed. Further, the students should have a basic understanding of deep learning which they gained through additional lectures, projects, or seminars. It is recommended to have worked with scientific literature before. This course is particularly designed for students that are in the last semester before writing their master thesis and have a strong interest in deep learning and computer vision.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Seminar Presentation | 50 | oral | approx. 20 minutes |
| (Deliverable assessment) Written Seminar Report | 50 | written | 10-15 pages |
Exam description
There are are two portfolio deliverable assessments:
1) a long seminar presentation including a discussion (50 points) and
2) a written seminar report (50 points).
1) a long seminar presentation including a discussion (50 points) and
2) a written seminar report (50 points).
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 18.
Registration procedures
Students intending to take this seminar need to follow the instructions on the ISIS course page for pre-semester application. Within the first 6 weeks after the commencement of the seminar, students will have to register for the module at Moses (MTS) and additionally at ISIS (TU Berlin's variant of 'Moodle') for teaching materials and communication.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Mahmoud Hassaballah and Ali Ismail Awad. "Deep Learning in Computer Vision Principles and Applications". CRC Press, 2020. isbn: 978-1-138-54442-0
- Ian Goodfellow, Yoshua Bengio, and Aaron Courville. "Deep Learning". MIT Press, 2016. ISBN: 978-0-262-03561-3
- Mohamed Elgendy. "Deep Learning for Vision Systems". Manning Publications, 2020. ISBN: 978-1-61729-619-2
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2025/26 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
Miscellaneous
Not specified