Deep Learning 2Module description #41072 / Version 2
- 6 CP
- Written exam
- Graded
- Summer semester
- English
| Module / Version | #41072 / #2 |
|---|---|
| Validity | Since Winter semester 2023/24 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Müller, Klaus-Robert |
| Grading | Graded |
| Exam format | Written exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34352000 FG Maschinelles Lernen |
Contact
| Office | FR 6-1 |
|---|---|
| Contact person | Eberle, Oliver |
| E-mail address | oliver.eberle@tu-berlin.de |
| Website | http://wiki.ml.tu-berlin.de/wiki/ |
Learning outcomes
Understanding of advanced techniques of deep learning, including the application of mathematical concepts such as differential equations, group theory and fix-point iteration in neural networks. Understanding of advanced deep neural network architectures used in practice (e.g. GANs, Transformer, normalizing flows, equivariant neural networks). Ability to implement advanced neural networks using common deep learning frameworks.
Content
Advanced techniques such as self-attention, equivariant convolutions, deep equilibrium networks, generative adversarial networks, neural differential equations and normalizing flows. Application of machine learning techniques such as self-supervised / autoregressive learning, density estimation, anomaly detection and reinforcement learning in neural networks. Approaches to accelerate and deploy neural network, such as distillation, quantization, and factorization.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Deep Learning 2 - main | Integrated course | Summer semester | [en] | 4 | ISIS |
Workload and credit points
Deep Learning 2 - main (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Concepts & Theory | 10 | 6 h | 60 h |
| Exercises | 10 | 6 h | 60 h |
| Programming | 10 | 6 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
The module will consist of weekly lectures accompanied with weekly homeworks.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
There are no formal prerequisites. However, the module builds on the module Deep Learning 1. Therefore basic knowledge of machine learning and neural networks is desirable. Prior knowledge multivariate calculus, probability theory and Python programming will be assumed.
Mandatory requirements for the module examination registration:
The examination requirements could not be retrieved.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Written exam |
| Language | English |
| Duration/Extent | 120 minutes |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
This module is not limited to a number of students.
Registration procedures
cf. course webpage
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – Lecture slides can be found at the module's page at ISIS
Recommended literature
No recommended literature given
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computational Engineering Science (Informationstechnik im Maschinenwesen) StuPO 2018 (17.01.2018) | SS 2025 | 2. Kernbereich: Simulation und Optimierung |
| WS 2025/26 | 2. Kernbereich: Simulation und Optimierung | |
| SS 2026 | 2. Kernbereich: Simulation und Optimierung | |
| WS 2026/27 | 2. Kernbereich: Simulation und Optimierung | |
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Kognitive Systeme / Cognitive Systems | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2026 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems |
| WS 2026/27 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Cognitive Systems | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering |
Miscellaneous
Not specified