Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

Recent Trends in Deep Learning for Computer VisionModule description #41089 / Version 1

← Module page Deutsche Fassung
This module description is not valid in the current semester (Winter semester 2026/27).
Module / Version#41089 / #1
ValiditySummer semester 2023 – Winter semester 2025/26
Available language(s)English
Credit points3
Person responsible for the moduleDemir, Begüm
GradingGraded
Exam formatPortfolio examination
Language(s) of instructionEnglish

Affiliation

FacultyFakultät IV
InstituteInstitut für Technische Informatik und Mikroelektronik
Academic chair34342200 FG Remote Sensing Image Analysis (RSiM)

Contact

OfficeEN 5
Contact personWitte, Bethany Jane
E-mail addressb.witte@tu-berlin.de
Websitehttps://rsim.berlin/

Learning outcomes

Participants of this seminar acquire advanced knowledge in the field of deep learning for computer vision. After completing this course, the students are capable of conducting a literature search, contextualizing scientific papers and presenting topics drawn from the deep learning and computer vision literature. Moreover, students participate in scientific discussions and have an opportunity to sharpen their critical thinking skills.

Content

The seminar aims to deepen the understanding of the participants in current research problems at the intersection of deep learning and computer vision. The topics include, yet are not limited to:
- The evolution of CNN architectures (depth, layer composition, activation functions, drop out);
- Vision transformers (attention mechanism, basic and advanced architectures);
- Data augmentation techniques (basic techniques, MixUp, CutOut, AutoAug, RandAug, etc.);
- Semi-supervised learning (temporal ensembling, mean teacher, co-teaching, consistency loss and pseudo-labeling, MixMatch, ReMixMatch, etc.);
- Self-supervised learning (foundations of representation learning, pre-text tasks, contrastive loss, triplet loss, SimCLR, BYOL, SimSiam, etc.);
- Diffusion Models and Dall-E 2 (current breakthroughs in fusion of semantics of text and image, generative modeling);
- Explainable AI (clever hans phenomena, backprogation based method, gradient-based methods);
- Optimization theory of neural networks;
- Learning and generalization theory of neural networks (shortcut learning, forgetting/memorization events, layer importance, sample difficulty, learning paths, learning bias in texture/shape).

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
Recent Trends in Deep Learning for Computer VisionSeminar Summer semester[en]2 ISIS

Workload and credit points

Recent Trends in Deep Learning for Computer Vision (Seminar)

Workload descriptionMultiplierHoursTotal
Attendance152 h30 h
Pre/post processing154 h60 h
90 h

The workload of the module adds up to 90 hours. The module therefore comprises 3 credit points.

Description of teaching and learning methods

At the beginning of the semester, there will be an overview lecture that will serve as an introduction to the current research problems in deep learning and computer vision. In addition, a set of primary literature works will be provided to assist the students to choose their topic. A follow-up lecture will guide the students through the process of how to work with scientific papers and write a scientific report. Then, the students will independently investigate the topics assigned to them and prepare a presentation. For the remaining part of the semester, each class will cover one of the course topics. Two students assigned to one topic will give a presentation of approximately 40 minutes (20 minutes each) that will be followed by a group discussion with all participants of the seminar. In addition to the talk, the students will also prepare a scientific report on their topic of approximately 10-15 pages.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

Good knowledge in Mathematics, especially linear algebra and statistics, are required. The courses Machine Learning I and Machine Learning II or an equivalent should have been completed. Further, the students should have a basic understanding of deep learning which they gained through additional lectures, projects, or seminars. It is recommended to have worked with scientific literature before. This course is particularly designed for students that are in the last semester before writing their master thesis and have a strong interest in deep learning and computer vision.

Mandatory requirements for the module examination registration:

This module has no examination requirements.

Completion of the module

GradingGraded
Exam formatPortfolio examination
Type of portfolio examination100 points in total
LanguageEnglish

Test elements

NamePoints/WeightCategoryDuration/Extent
(Deliverable assessment) Seminar Presentation50oralapprox. 20 minutes
(Deliverable assessment) Written Seminar Report50written10-15 pages

Exam description

There are are two portfolio deliverable assessments:
1) a long seminar presentation including a discussion (50 points) and
2) a written seminar report (50 points).

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Summer semester.

Maximum number of participants

The maximum capacity of participants is 18.

Registration procedures

Students intending to take this seminar need to follow the instructions on the ISIS course page for pre-semester application. Within the first 6 weeks after the commencement of the seminar, students will have to register for the module at Moses (MTS) and additionally at ISIS (TU Berlin's variant of 'Moodle') for teaching materials and communication.

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

unavailable

Recommended literature

  • Mahmoud Hassaballah and Ali Ismail Awad. "Deep Learning in Computer Vision Principles and Applications". CRC Press, 2020. isbn: 978-1-138-54442-0
  • Ian Goodfellow, Yoshua Bengio, and Aaron Courville. "Deep Learning". MIT Press, 2016. ISBN: 978-0-262-03561-3
  • Mohamed Elgendy. "Deep Learning for Vision Systems". Manning Publications, 2020. ISBN: 978-1-61729-619-2

Assigned programs

This module version is used in the following programs:

Program / program versionSemester(s)Curriculum component
Computer Engineering
Computer Engineering (M. Sc.) - StuPO 2015
SS 2025Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2025/26Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems
Computer Science (Informatik)
Computer Science (Informatik) (M. Sc.) - StuPO 2015
SS 2025Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2025/26Studiengebiete › Kognitive Systeme / Cognitive Systems
Electrical Engineering
Electrical Engineering (M. Sc.) - StuPO 2015
SS 2025Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction
WS 2025/26Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction

Miscellaneous

Not specified