EDML - Engineering Data for Machine LearningModule description #41221 / Version 1
- 6 CP
- Portfolio examination
- Graded
- Winter semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
Current version (v2)
| Module / Version | #41221 / #1 |
|---|---|
| Validity | Winter semester 2024/25 – Summer semester 2026 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Schelter, Sebastian |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34353500 FG Management von Data Science-Prozessen (BIFOLD) |
Contact
| Office | EN 7 |
|---|---|
| Contact person | Schelter, Sebastian |
| E-mail address | schelter@tu-berlin.de |
| Website | https://deem.berlin/#teaching |
Learning outcomes
- Describe the lifecycle of data in systems employing machine learning and predictive analytics
- Employ fundamental methods for creating and maintaining datasets such as incremental view maintenance and fine-grained data provenance
- Implement efficient data preparation programs using state-of-the-art relational and dataflow processing systems
- Identify and potentially correct data issues related to data quality, privacy violations or technical bias
- Design and validate a scalable data architecture for preparing and maintaining data for machine learning applications
- Employ fundamental methods for creating and maintaining datasets such as incremental view maintenance and fine-grained data provenance
- Implement efficient data preparation programs using state-of-the-art relational and dataflow processing systems
- Identify and potentially correct data issues related to data quality, privacy violations or technical bias
- Design and validate a scalable data architecture for preparing and maintaining data for machine learning applications
Content
This highly technical course focuses on the engineering and life-cycle management of data for production machine learning deployments. The course starts by recapping fundamentals about relational data processing and dataflow systems. Subsequently, students learn about encoding, storing and managing vectorised feature representations of heterogeneous input data sources for machine learning applications, and the architecture of current state-of-the- art systems for this task such as Google’s Tensorflow Extended Platform. Concurrently, the students will be exposed to foundational theory for this problem space, such as incremental view maintenance for relational data, fine-grained data provenance tracking via provenance semi-rings and differential computation.
In addition, students will learn to identify, quantify and address common quality issues with respect to the completeness and consistency of the data. Furthermore, they will learn about potential discrimination in data-driven decision making resulting from technical bias in data preparation systems, and technical challenges with respect to the compliance with regulations for private data such as the “right-to-be-forgotten” from GDPR. Finally, students will be exposed to ongoing research efforts in this space such as ML pipeline debugging or error detection techniques from data-centric AI. In addition, they will have the opportunity to discuss the practical implications of the covered technologies with invited practitioners.
In addition, students will learn to identify, quantify and address common quality issues with respect to the completeness and consistency of the data. Furthermore, they will learn about potential discrimination in data-driven decision making resulting from technical bias in data preparation systems, and technical challenges with respect to the compliance with regulations for private data such as the “right-to-be-forgotten” from GDPR. Finally, students will be exposed to ongoing research efforts in this space such as ML pipeline debugging or error detection techniques from data-centric AI. In addition, they will have the opportunity to discuss the practical implications of the covered technologies with invited practitioners.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Engineering Data for Machine Learning | Exercise | Winter semester | [en] | 2 | WS 2026/27 (1) ISIS | |
| Engineering Data for Machine Learning | Lecture | Winter semester | [en] | 2 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (2)
Engineering Data for Machine Learning (Exercise) 1
- Data Engineering for Machine Learning (DEML) (Übung) Termingruppe 1
Engineering Data for Machine Learning (Lecture) 1
- Data Engineering for Machine Learning (DEML) (Vorlesung) Termingruppe 1
Workload and credit points
Engineering Data for Machine Learning (Exercise)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 1 h | 15 h |
| Pre/post processing | 15 | 2 h | 30 h |
| 45 h | |||
Engineering Data for Machine Learning (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 3 h | 45 h |
| Project work | 7 | 3 h | 21 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 126 h | |||
The workload of the module adds up to 171 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
- Lecture
- Working independently on e.g. a project or thesis
- Presentation
- Self-study
- Computer lab session/practical training
- Working independently on e.g. a project or thesis
- Presentation
- Self-study
- Computer lab session/practical training
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Completed bachelor degree
Completed basic courses on applied machine learning, data management, and distributed systems
Completed basic courses on applied machine learning, data management, and distributed systems
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Programming assignment 1 | 10 | written | 1-2 weeks |
| (Deliverable assessment) Programming assignment 2 | 10 | practical | 1-2 weeks |
| (Deliverable assessment) Programming assignment 3 | 10 | practical | 1-2 weeks |
| (Deliverable assessment) Preparation of questions for lecture discussions | 10 | practical | 5-10 questions |
| (Deliverable assessment) Project presentation | 20 | oral | 15-25min (per group) |
| (Deliverable assessment) Project report (including code) | 40 | written | 4-6 pages |
Exam description
The final grade according to § 68 (2) AllgStuPO will be calculated with the faculty grading Table 1.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter semester.
Maximum number of participants
The maximum capacity of participants is 24.
Registration procedures
Admission to the lecture is limited. Please have a look at https://deem.berlin/#teaching before the lecture period starts to get information on how you can register.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
No recommended literature given
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| SS 2026 | Wahlpflicht Studiengebiet B › Kognitive Systeme / Cognitive Systems | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Studiengebiete › Kognitive Systeme / Cognitive Systems | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Kognitive Systeme / Cognitive Systems |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering |
Miscellaneous
Not specified