Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

MLMMI - Machine Learning Model Management and InferenceModule description #41289 / Version 2

← Module page Deutsche Fassung
Module / Version#41289 / #2
ValiditySince Summer semester 2026
Available language(s)English, German
Credit points6
Person responsible for the moduleSchelter, Sebastian
GradingGraded
Exam formatPortfolio examination
Language(s) of instructionEnglish

Affiliation

FacultyFakultät IV
InstituteInstitut für Softwaretechnik und Theoretische Informatik
Academic chair34353500 FG Management von Data Science-Prozessen (BIFOLD)

Contact

OfficeNot specified
Contact personNot specified
E-mail addressNot specified
WebsiteNot specified

Learning outcomes

- Identify the data management challenges in the model management and inference
- Design a model management strategy using registries to track model versions, lineage, and metadata for reproducibility
- Apply model compression techniques, including quantization and pruning
- Design an optimized model serving framework
- Monitor model performance issues in production

Content

This advanced course focuses on the system and data management challenges in managing and serving machine learning (ML) models in production environments. The course starts by recapping standard ML pipelines up to the training stage. The lifecycle of an ML model extends far beyond training. Students will be introduced to foundational frameworks for model management, where trained models are treated as core data artifacts. The course covers data management techniques and optimizations, including model versioning, lineage tracking, and metadata management. Building on this, students will explore the architectures of modern model serving systems, along with performance optimizations such as dynamic batching, model compilation, and resource-efficient inference execution.

Furthermore, students will be exposed to state-of-the-art research on inference and model management. Through a combination of seminal research papers and hands-on projects, students will gain a comprehensive understanding of the entire model lifecycle beyond training, preparing them for both academic research and real-world system design.

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
MLMMI - Machine Learning Model Management and InferenceLecture Summer semester[en]2 ISIS
MLMMI - Machine Learning Model Management and InferenceExercise Summer semester[en]2 ISIS

Workload and credit points

MLMMI - Machine Learning Model Management and Inference (Lecture)

Workload descriptionMultiplierHoursTotal
Attendance153 h45 h
Pre/post processing154 h60 h
105 h

MLMMI - Machine Learning Model Management and Inference (Exercise)

Workload descriptionMultiplierHoursTotal
Attendance151 h15 h
Pre/post processing152 h30 h
45 h

Course-independent workload

Workload descriptionMultiplierHoursTotal
Project work73 h21 h
21 h

The workload of the module adds up to 171 hours. The module therefore comprises 6 credit points.

Description of teaching and learning methods

- Lecture
- Working independently on e.g., a project or report
- Presentation
- Self-study
- Computer lab session/practical training

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

- Completed bachelor degree
- Completed basic courses on applied machine learning, data management, and distributed systems

Mandatory requirements for the module examination registration:

This module has no examination requirements.

Completion of the module

GradingGraded
Exam formatPortfolio examination
Type of portfolio examination100 points in total
LanguageEnglish

Test elements

NamePoints/WeightCategoryDuration/Extent
(Deliverable assessment) Programming assignment 110written1-2 weeks
(Deliverable assessment) Programming assignment 210practical1-2 weeks
(Deliverable assessment) Programming assignment 310practical1-2 weeks
(Deliverable assessment) Preparation of questions for lecture discussions10practical5-10 questions
(Deliverable assessment) Project presentation20oral15-25min (per group)
(Deliverable assessment) Project report (including code)40written4-6 pages

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Summer semester.

Maximum number of participants

The maximum capacity of participants is 24.

Registration procedures

Admission to the lecture is limited. Please take a look at https://deem.berlin/#teaching before the lecture period starts to get information on how you can register.

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

unavailable

Recommended literature

No recommended literature given

Assigned programs

This module version is used in the following programs:

Program / program versionSemester(s)Curriculum component
Computer Engineering
Computer Engineering (M. Sc.) - StuPO 2015
SS 2026Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
WS 2026/27Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
Computer Science (Informatik)
Computer Science (Informatik) (M. Sc.) - StuPO 2015
SS 2026Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
WS 2026/27Wahlpflichtbereich › Studiengebiet › Data and Software Engineering / Data and Software Engineering
Electrical Engineering
Electrical Engineering (M. Sc.) - StuPO 2015
SS 2026Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
WS 2026/27Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
Industrial Engineering and Management
Industrial Engineering and Management (M. Sc.) - StuPO 2026
WS 2026/27Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering
Information Systems Management (Wirtschaftsinformatik)
Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017
SS 2026Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering
WS 2026/27Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering
Computer Science (Informatik) (M. Sc.)
Studiengebiete: Data and Software Engineering

Computer Engineering (M. Sc.)
Studiengebiete: Data and Software Engineering

Electrical Engineering (M. Sc.)
Studiengebiete: Data and Software Engineering

Information Systems Management (Wirtschaftsinformatik) (M. Sc.)
Studiengebiete: Data and Software Engineering

Miscellaneous

Not specified