Data Integration: Algorithms and SystemsModule description #41213 / Version 2
- 6 CP
- Oral exam
- Graded
- Winter semester
- English
| Module / Version | #41213 / #2 |
|---|---|
| Validity | Since Winter semester 2024/25 |
| Available language(s) | English, German |
| Credit points | 6 |
| Person responsible for the module | Abedjan, Ziawasch |
| Grading | Graded |
| Exam format | Oral exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34353400 FG Data Integration and Data Preparation (BIFOLD) |
Contact
| Office | TEL 11 |
|---|---|
| Contact person | Abedjan, Ziawasch |
| E-mail address | abedjan@tu-berlin.de |
| Website | https://www.tu.berlin/d2ip |
Learning outcomes
“Data integration is the 800-pound gorilla in the corner, and everyone’s got it in spades,” according to Mike Stonebraker, MIT professor and Turing Award Laureate. The most challenging and time-consuming task of data scientists in the era of Big Data is to consolidate data from different sources, overcoming dirty data, heterogeneity in data representations, and incompleteness of data. In this course, we will surface the entire pipeline of an information integration workflow, by learning about existing integration architectures, algorithms in data cleansing, schema matching, and data fusion. Furthermore, we will discuss state-of-the-art systems and prominent use cases of information integration techniques.
Content
The course has the following main topics:
-Distribution and autonomy
-Foundations of data integration
- Architectures (data warehouses, federated databases)
-String Matching
-Schema matching/mapping
- Global-as-View and Lokal-as-View modelling
-Data cleansing
-Duplicate detection
-Data quality
-Data Profiing
-Distribution and autonomy
-Foundations of data integration
- Architectures (data warehouses, federated databases)
-String Matching
-Schema matching/mapping
- Global-as-View and Lokal-as-View modelling
-Data cleansing
-Duplicate detection
-Data quality
-Data Profiing
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Data Integration: Algorithms and Systems | Tutorial | Winter semester | [en] | 1 | WS 2026/27 (1) ISIS | |
| Data Integration: Algorithms and Systems | Lecture | Winter semester | [en] | 3 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (2)
Data Integration: Algorithms and Systems (Tutorial) 1
- Data Integration: Algorithms and Systems (DI) (Tutorium) Termingruppe 1
Data Integration: Algorithms and Systems (Lecture) 1
- Data Integration: Algorithms and Systems (DI) (Vorlesung) Termingruppe 1
Workload and credit points
Data Integration: Algorithms and Systems (Tutorial)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 1 h | 15 h |
| Pre/post processing | 15 | 3 h | 45 h |
| 60 h | |||
Data Integration: Algorithms and Systems (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 1 | 2 h | 2 h |
| Exam | 15 | 3 h | 45 h |
| Pre/post processing | 15 | 3 h | 45 h |
| 92 h | |||
The workload of the module adds up to 152 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
Lecture and Labs
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Having successfully attended database classes, such as ISDA at TU Berlin and basic courses on machine learning or data science.
Mandatory requirements for the module examination registration:
The examination requirements could not be retrieved.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Oral exam |
| Language | English, German |
| Duration/Extent | 20 Minuten |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter semester.
Maximum number of participants
The maximum capacity of participants is 60.
Registration procedures
Registration modality will be announced on ISIS
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- https://www.assets.dpunkt.de/openbooks/informationsintegration.pdf
- https://www.sciencedirect.com/book/9780124160446/principles-of-data-integration
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Studiengebiete › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | WS 2024/25 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
| SS 2025 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| WS 2025/26 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| SS 2026 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| WS 2026/27 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks |
Miscellaneous
Not specified