Deep Learning 2-XModule description #41142 / Version 1
- 9 CP
- Written exam
- Graded
- Summer semester
- English
| Module / Version | #41142 / #1 |
|---|---|
| Validity | Since Summer semester 2024 |
| Available language(s) | English, German |
| Credit points | 9 |
| Person responsible for the module | Müller, Klaus-Robert |
| Grading | Graded |
| Exam format | Written exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34352000 FG Maschinelles Lernen |
Contact
| Office | FR 6-1 |
|---|---|
| Contact person | Eberle, Oliver |
| E-mail address | oliver.eberle@tu-berlin.de |
| Website | https://web.ml.tu-berlin.de/ |
Learning outcomes
Understanding of advanced techniques of deep learning, including the application of mathematical concepts such as differential equations, group theory and fix-point iteration in neural networks. Understanding of advanced deep neural network architectures used in practice (e.g. GANs, Transformer, normalizing flows, equivariant neural networks). Ability to implement advanced neural networks using common deep learning frameworks.
Content
Advanced techniques such as self-attention, equivariant convolutions, deep equilibrium networks, generative adversarial networks, neural differential equations and normalizing flows. Application of machine learning techniques such as self-supervised / autoregressive learning, density estimation, anomaly detection and reinforcement learning in neural networks. Approaches to accelerate and deploy neural network, such as distillation, quantization, and factorization.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Deep Learning 2 - main | Integrated course | Summer semester | [de] | 4 | ISIS |
Compulsory elective area
A selection of the following courses must be completed:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Bayesian Learning | Lecture | 343 L 8043 | Winter semester | – | 2 | ISIS |
| Classical Topics in ML | Seminar | 0434 L 588 | Winter semester | – | 2 | ISIS |
| Explainable Machine Learning | Seminar | Winter and summer semester | [de] | 2 | ISIS | |
| Generative Models | Seminar | Winter and summer semester | [de] | 2 | ISIS | |
| Machine Learning and Data Management Systems | Seminar | Winter and summer semester | – | 2 | ISIS | |
| Machine Learning in the Sciences | Lecture | Summer semester | – | 2 | ISIS | |
| Mathematische Grundlagen für Maschinelles Lernen | Course | 0434 L 545 | Winter and summer semester | – | 2 | WS 2026/27 (1) ISIS |
| Software engineering practices for scientific software development | Seminar | Winter and summer semester | [de] | 2 | ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (1)
Mathematische Grundlagen für Maschinelles Lernen (Course) 1
- Mathematische Grundlagen für Maschinelles Lernen (Math4ML) (Vorlesung) 1. Termingruppe 0434 L 545
Workload and credit points
Deep Learning 2 - main (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 4 h | 60 h |
| Pre/post processing | 15 | 8 h | 120 h |
| 180 h | |||
Bayesian Learning (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
Classical Topics in ML (Seminar)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 6 h | 90 h |
| 120 h | |||
Explainable Machine Learning (Seminar)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
Generative Models (Seminar)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
Machine Learning and Data Management Systems (Seminar)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| 30 h | |||
Machine Learning in the Sciences (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
Mathematische Grundlagen für Maschinelles Lernen (Course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
Software engineering practices for scientific software development (Seminar)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 90 h | |||
The workload of the module adds up to 870 hours. The module therefore comprises 9 credit points.
Description of teaching and learning methods
The module will consist of weekly lectures accompanied with weekly homeworks.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
There are no formal prerequisites. However, the module builds on the module Deep Learning 1. Therefore basic knowledge of machine learning and neural networks is desirable. Prior knowledge multivariate calculus, probability theory and Python programming will be assumed.
Mandatory requirements for the module examination registration:
The examination requirements could not be retrieved.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Written exam |
| Language | English |
| Duration/Extent | 120 minutes |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
This module is not limited to a number of students.
Registration procedures
cf. course webpage
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – Lecture slides can be found at the module's page at ISIS
Recommended literature
No recommended literature given
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Automatisierungstechnik / Automation and Control |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Kognitive Systeme / Cognitive Systems | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Automatisierungstechnik / Automation and Control | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering |
Miscellaneous
Not specified