Master Project: Large Scale Data IntegrationModule description #41215 / Version 3
- 9 CP
- Portfolio examination
- Graded
- Winter and summer semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
Current version (v4)
| Module / Version | #41215 / #3 |
|---|---|
| Validity | Summer semester 2025 – Winter semester 2025/26 |
| Available language(s) | English, German |
| Credit points | 9 |
| Person responsible for the module | Abedjan, Ziawasch |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34353400 FG Data Integration and Data Preparation (BIFOLD) |
Contact
| Office | TEL 11 |
|---|---|
| Contact person | Abedjan, Ziawasch |
| E-mail address | abedjan@tu-berlin.de |
| Website | https://www.tu.berlin/d2ip |
Learning outcomes
In this course the students will develop solutions for large scale data integration. Working in groups of up to 4 students, the goal is to reproduce an existing research prototype and enhance it with their own ideas. Each group is accompanied by a mentor from the D2IP group to report and capture progress. The students will learn to implement scalable algorithms, evaluate them systematically, and to read and interpret technical papers and to critically judge experimental results. At the same time, students will learn to deal with data heterogeneity problems at scale.
Content
* Selection of a project and building a team
* Discussion rounds on design, implementation, tests, and experiments
* Prototype implementation, tests, and experiments
* 15min oral presentation of the created prototype
* Discussion rounds on design, implementation, tests, and experiments
* Prototype implementation, tests, and experiments
* 15min oral presentation of the created prototype
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Large Scale Data Integration (LSDIPro) | Project | Winter and summer semester | [en] | 6 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (1)
Large Scale Data Integration (LSDIPro) (Project) 1
- Large Scale Data Integration (LSDIPro) (Projekt) Termingruppe 1
Workload and credit points
Large Scale Data Integration (LSDIPro) (Project)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 6 h | 90 h |
| Pre/post processing | 15 | 12 h | 180 h |
| 270 h | |||
The workload of the module adds up to 270 hours. The module therefore comprises 9 credit points.
Description of teaching and learning methods
Guided and self-organized project work.
Students pick a project from a provided list, read the paper and clarify understanding problems with a mentor and scope the implementation goal. The algorithms and systems are reimplemented and systematically evaluated and enhanced. These projects are augmented by regular discussion rounds and a final presentation of the obtained results.
Students pick a project from a provided list, read the paper and clarify understanding problems with a mentor and scope the implementation goal. The algorithms and systems are reimplemented and systematically evaluated and enhanced. These projects are augmented by regular discussion rounds and a final presentation of the obtained results.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Completed basic courses on applied machine learning and data management
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Experimentation | 30 | practical | N/A |
| (Deliverable assessment) Implementation and Documentation | 50 | practical | N/A |
| (Deliverable assessment) Presentation | 20 | oral | 15 min |
Exam description
The project can be conducted individually or in teams of up to 4 students.
The module is completed with a portfolio exam consisting of two parts:
(1) The implementation of a prototype for the selected paper, including documentation. Students submit their source code and additional artifacts (such as documentation) for the grading. To create the prototype, students work in a self-organized manner. Typical steps include getting familiar with an existing paper to integrate the work into (if applicable for the specific topic), developing an initial design for their selected project topic, implementing this design in a specific programming language, documenting the prototype, creating test cases for automated testing.
(2) The students are supposed to systematically benchmark the developed solution and and test minor enhancements. Students can discuss their ideas with and get feedback from their project mentor.
(2) A slide presentation of the team's project in front of the course, including a discussion. In this presentation, the students give insights into, e.g., the motivation of their paper, their overall approach, specifics of their implementation, as well as their experimental results.
The module is completed with a portfolio exam consisting of two parts:
(1) The implementation of a prototype for the selected paper, including documentation. Students submit their source code and additional artifacts (such as documentation) for the grading. To create the prototype, students work in a self-organized manner. Typical steps include getting familiar with an existing paper to integrate the work into (if applicable for the specific topic), developing an initial design for their selected project topic, implementing this design in a specific programming language, documenting the prototype, creating test cases for automated testing.
(2) The students are supposed to systematically benchmark the developed solution and and test minor enhancements. Students can discuss their ideas with and get feedback from their project mentor.
(2) A slide presentation of the team's project in front of the course, including a discussion. In this presentation, the students give insights into, e.g., the motivation of their paper, their overall approach, specifics of their implementation, as well as their experimental results.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter and summer semester.
Maximum number of participants
The maximum capacity of participants is 24.
Registration procedures
The registration details can be found in the ISIS course.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
No recommended literature given
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2025 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
| WS 2025/26 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
Miscellaneous
Not specified