Architecture of Machine Learning SystemsModule description #41078 / Version 2
- 6 CP
- Written exam
- Graded
- Summer semester
- English
| Module / Version | #41078 / #2 |
|---|---|
| Validity | Since Summer semester 2025 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Böhm, Matthias |
| Grading | Graded |
| Exam format | Written exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34352900 FG Big Data Engineering |
Contact
| Office | Not specified |
|---|---|
| Contact person | Böhm, Matthias |
| E-mail address | matthias.boehm@tu-berlin.de |
| Website | Not specified |
Learning outcomes
Machine learning (ML) applications profoundly transform our lives, and many domains such as health care, finance, media, transportation, production, and information technology itself. In a narrow sense, ML systems are software systems underpinning theses ML applications. However, in a broad sense, ML systems comprise the entire systems from ML applications, over the compiler/runtime stack, to the underlying heterogeneous hardware devices.
The overall objective of this module is to provide a holistic overview of the architecture, internals, and important concepts of modern (large-scale) ML systems. To this end, students acquire important competencies related to ML systems:
O1: Understanding of the characteristics of ML systems and alternatives, which enables a better evaluation and usage of such systems
O2: Understanding of effective techniques related to ML systems, which enables building and extending ML and data systems
The overall objective of this module is to provide a holistic overview of the architecture, internals, and important concepts of modern (large-scale) ML systems. To this end, students acquire important competencies related to ML systems:
O1: Understanding of the characteristics of ML systems and alternatives, which enables a better evaluation and usage of such systems
O2: Understanding of effective techniques related to ML systems, which enables building and extending ML and data systems
Content
This module covers the architecture and essential concepts of modern machine learning (ML) systems for both local and large-scale machine learning. These architectures include systems for data-parallel execution, parameter servers, ML lifecycle systems, and the integration of ML into database systems. The covered topics focus both on a microscopic view of internal compilation, execution, and data management techniques, as well as a macroscopic view of end-to-end ML pipelines. In detail, the module covers the following topics which also reflect the lecture calendar (with a separate 90-120min lecture per topic):
A: Overview and ML System Internals
01 Introduction and Overview
02 Languages, Architectures, and System Landscape
03 Size Inference, Rewrites, and Operator Selection
04 Operator Fusion and Runtime Adaptation
05 Data- and Task-Parallel Execution
06 Parameter Servers
07 Hybrid Execution and HW Accelerators
08 Caching, Partitioning, Indexing and Compression
B: ML Lifecycle Systems
09 Data Acquisition, Cleaning, and Preparation
10 Model Selection and Management
11 Model Debugging, Fairness, and Explainability
12 Model Serving Systems and Techniques
The module contains both lectures and exercises/programming projects which are offered as separate courses in order to increase flexibility.
A: Overview and ML System Internals
01 Introduction and Overview
02 Languages, Architectures, and System Landscape
03 Size Inference, Rewrites, and Operator Selection
04 Operator Fusion and Runtime Adaptation
05 Data- and Task-Parallel Execution
06 Parameter Servers
07 Hybrid Execution and HW Accelerators
08 Caching, Partitioning, Indexing and Compression
B: ML Lifecycle Systems
09 Data Acquisition, Cleaning, and Preparation
10 Model Selection and Management
11 Model Debugging, Fairness, and Explainability
12 Model Serving Systems and Techniques
The module contains both lectures and exercises/programming projects which are offered as separate courses in order to increase flexibility.
Module components
Compulsory area
The following courses are mandatory for this module:
Workload and credit points
Architecture of Machine Learning Systems (Exercise)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance Discussion Rounds | 3 | 2 h | 6 h |
| Exercise Prototype Implementation | 1 | 80 h | 80 h |
| 86 h | |||
Architecture of Machine Learning Systems (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Exam Preparation | 1 | 30 h | 30 h |
| Attendance Lectures | 15 | 3 h | 45 h |
| Pre/post processing Lectures | 15 | 1 h | 15 h |
| 90 h | |||
The workload of the module adds up to 176 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
This module combines traditional lectures (on ML system internals and ML lifecycle systems), supporting examples of open source ML systems, as well as practical exercises/projects on related topics. For the practical part, teams of 1-3 students can pick one of two alternatives:
a) Contribution of a unique feature to an open-source ML system (from a list of project proposals), or
b) Alternative exercise on data-centric ML pipelines from data preparation, over model building, tuning, and parallelization, to model debugging
a) Contribution of a unique feature to an open-source ML system (from a list of project proposals), or
b) Alternative exercise on data-centric ML pipelines from data preparation, over model building, tuning, and parallelization, to model debugging
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Completed bachelor degree
Completed basic courses on applied machine learning, data management, and distributed systems
Completed basic courses on applied machine learning, data management, and distributed systems
Mandatory requirements for the module examination registration:
The examination requirements could not be retrieved.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Written exam |
| Language | English |
| Duration/Extent | 90min |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 250.
Registration procedures
Registration in ISIS and exercise/project selection within the first 4 weeks of the semester.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – https://mboehm7.github.io/teaching/ss22_amls/index.htm
Recommended literature
- Matthias Boehm, Arun Kumar, Jun Yang: Data Management in Machine Learning Systems. Synthesis Lectures on Data Management, Morgan & Claypool Publishers 2019
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| SS 2026 | Wahlpflicht Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Studiengebiete › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks |
Miscellaneous
Zuordnung Master:
Studiengebiete
Verteilte Systeme und Netze
Data und Software Eng.
Kognitive Systeme
Studiengebiete
Verteilte Systeme und Netze
Data und Software Eng.
Kognitive Systeme