DEML - Data Engineering for Machine LearningModule description #41221 / Version 2
- 6 CP
- Portfolio examination
- Graded
- Winter semester
- English
| Module / Version | #41221 / #2 |
|---|---|
| Validity | Since Winter semester 2026/27 |
| Available language(s) | English, German |
| Credit points | 6 |
| Person responsible for the module | Schelter, Sebastian |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34353500 FG Management von Data Science-Prozessen (BIFOLD) |
Contact
| Office | EN 7 |
|---|---|
| Contact person | Schelter, Sebastian |
| E-mail address | schelter@tu-berlin.de |
| Website | https://deem.berlin/#teaching |
Learning outcomes
- Describe the lifecycle of data in systems employing machine learning and predictive analytics
- Employ fundamental methods for creating and maintaining datasets such as incremental view maintenance and fine-grained data provenance
- Implement efficient data preparation programs using state-of-the-art relational and dataflow processing systems
- Identify and potentially correct data issues related to data quality, privacy violations or technical bias
- Design and validate a scalable data architecture for preparing and maintaining data for machine learning applications
- Employ fundamental methods for creating and maintaining datasets such as incremental view maintenance and fine-grained data provenance
- Implement efficient data preparation programs using state-of-the-art relational and dataflow processing systems
- Identify and potentially correct data issues related to data quality, privacy violations or technical bias
- Design and validate a scalable data architecture for preparing and maintaining data for machine learning applications
Content
This highly technical course focuses on the engineering and life-cycle management of data for production machine learning deployments. The course starts by recapping fundamentals about relational data processing and dataflow systems. Subsequently, students learn about encoding, storing and managing vectorised feature representations of heterogeneous input data sources for machine learning applications, and the architecture of current state-of-the- art systems for this task and recent agentic approachesd to generate ML pipelines. Concurrently, the students will be exposed to foundational theory for this problem space, such as incremental view maintenance for relational data, fine-grained data provenance tracking via provenance semi-rings and differential computation.
In addition, students will learn to identify, quantify and address common quality issues with respect to the completeness and consistency of the data. Furthermore, they will learn about potential discrimination in data-driven decision making resulting from technical bias in data preparation systems, and technical challenges with respect to the compliance with regulations for private data such as the “right-to-be-forgotten” from GDPR. Finally, students will be exposed to ongoing research efforts in this space such as ML pipeline debugging or error detection techniques from data-centric AI. In addition, they will have the opportunity to discuss the practical implications of the covered technologies with invited practitioners.
In addition, students will learn to identify, quantify and address common quality issues with respect to the completeness and consistency of the data. Furthermore, they will learn about potential discrimination in data-driven decision making resulting from technical bias in data preparation systems, and technical challenges with respect to the compliance with regulations for private data such as the “right-to-be-forgotten” from GDPR. Finally, students will be exposed to ongoing research efforts in this space such as ML pipeline debugging or error detection techniques from data-centric AI. In addition, they will have the opportunity to discuss the practical implications of the covered technologies with invited practitioners.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Data Engineering for Machine Learning (DEML) | Lecture | Winter semester | [en] | 2 | WS 2026/27 (1) ISIS | |
| Data Engineering for Machine Learning (DEML) | Exercise | Winter semester | [en] | 2 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (2)
Data Engineering for Machine Learning (DEML) (Lecture) 1
- Data Engineering for Machine Learning (DEML) (Vorlesung) Termingruppe 1
Data Engineering for Machine Learning (DEML) (Exercise) 1
- Data Engineering for Machine Learning (DEML) (Übung) Termingruppe 1
Workload and credit points
Data Engineering for Machine Learning (DEML) (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 3 h | 45 h |
| Project work | 7 | 3 h | 21 h |
| Pre/post processing | 15 | 4 h | 60 h |
| 126 h | |||
Data Engineering for Machine Learning (DEML) (Exercise)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 1 h | 15 h |
| Pre/post processing | 15 | 2 h | 30 h |
| 45 h | |||
The workload of the module adds up to 171 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
- Lecture
- Working independently on e.g. a project
- Presentation
- Self-study
- Computer lab session/practical training
- Working independently on e.g. a project
- Presentation
- Self-study
- Computer lab session/practical training
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
The course requires basic knowledge in the areas of relational databases, large-scale data engineering, and machine learning. Programming skills are required.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Preparation of questions for lecture discussions | 10 | practical | 5-10 questions |
| (Deliverable assessment) Group presentation for project | 20 | oral | 15-25min (per group) |
| (Deliverable assessment) Project code (including documentation) | 20 | practical | Implementation of a given test scenario |
| (Selective Learning Assessment) Oral consultation on course contents | 50 | oral | 15-20min |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter semester.
Maximum number of participants
The maximum capacity of participants is 24.
Registration procedures
Admission to the lecture is limited. Please have a look at https://deem.berlin/#teaching before the lecture period starts to get information on how you can register.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
No recommended literature given
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Kognitive Systeme / Cognitive Systems |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering |
Miscellaneous
Not specified