The 800-pound Gorilla in the corner: Data IntegrationModule description #40791 / Version 3
- 6 CP
- Oral exam
- Graded
- Winter and summer semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
| Module / Version | #40791 / #3 |
|---|---|
| Validity | SS 2017 – WS 2017/18 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Abedjan, Ziawasch |
| Grading | Graded |
| Exam format | Oral exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34352300 FG Big Data Management (Juniorprof.) |
Contact
| Office | EN 7 |
|---|---|
| Contact person | Abedjan, Ziawasch |
| E-mail address | sekr@bigdama.tu-berlin.de |
| Website | http://www.bigdama.tu-berlin.de/menue/big_data_management_group/ |
Learning outcomes
“Data integration is the 800-pound gorilla in the corner, and everyone’s got it in spades,” according to Mike Stonebraker, MIT professor and Turing Award Laureate. The most challenging and time-consuming task of data scientists in the era of Big Data is to consolidate data from different sources, overcoming dirty data, heterogeneity in data representations, and incompleteness of data. In this course, we will surface the entire pipeline of an information integration workflow, by learning about existing integration architectures, algorithms in data cleansing, schema matching, and data fusion. Furthermore, we will discuss state-of-the-art systems and prominent use cases of information integration techniques.
Content
The course has the following main topics:
- Distribution and autonomy
- Foundations of data integration
- String Matching
- Schema matching/mapping
- Global-as-View and Lokal-as-View modelling
- Data cleansing
- Duplicate detection
- Data quality
- Distribution and autonomy
- Foundations of data integration
- String Matching
- Schema matching/mapping
- Global-as-View and Lokal-as-View modelling
- Data cleansing
- Duplicate detection
- Data quality
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Data Integration | Integrated course | 4523 L 08957 | Winter and summer semester | – | 4 | ISIS |
Workload and credit points
Data Integration (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Präsentation der Übung | 15 | 2 h | 30 h |
| Präsenz | 15 | 4 h | 60 h |
| Übungsaufgaben/Praxisteil (Fallbeispiel) | 15 | 2 h | 30 h |
| Vor- und Nachbearbeitung (inkl. Lesen der Primärliteratur und eigenem Vortrag) | 15 | 4 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
Vorlesung und Übung
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Die Voraussetzungen sind das abgeschlossene Bachelorstudium und Grundkenntnisse im Bereich des Datenbankmanagements und Grundkenntnisse in mindestens einer modernen Programmier- oder Skriptsprache.
Mandatory requirements for the module examination registration:
The examination requirements could not be retrieved.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Oral exam |
| Language | English |
| Duration/Extent | 20 Minuten |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter and summer semester.
Maximum number of participants
The maximum capacity of participants is 45.
Registration procedures
Alle Teilnehmer/innen müssen sich vor dem ersten Lehrveranstaltungstermin mit dem Anmeldetool auf den BigDaMa-Webseiten (http://www.bigdama.tu-berlin.de/) für dieses Modul bei BigDaMa anmelden. Beachten Sie bitte unbedingt alle Regelungen Ihres Studienganges! Die Anmeldung zur Prüfung erfolgt über ein elektronisches Prüfungsanmeldesystem.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Principles of Data Integration. Anhai Doan, Alon Halevy, Zachary Ives. Morgan Kaufmann, 1st edition (2012), 520 pages Ulf Leser and Felix Naumann: Informationsintegration, dpunkt Verlag, 2006.
Assigned programs
This module is not used in any program.
Miscellaneous
Not specified