Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

Data Integration and Large-scale AnalysisModule description #41112 / Version 2

← Module page Deutsche Fassung
Module / Version#41112 / #2
ValiditySince Summer semester 2026
Available language(s)English, German
Credit points6
Person responsible for the moduleBöhm, Matthias
GradingGraded
Exam formatWritten exam
Language(s) of instructionEnglish

Affiliation

FacultyFakultät IV
InstituteInstitut für Softwaretechnik und Theoretische Informatik
Academic chair34352900 FG Big Data Engineering

Contact

OfficeNot specified
Contact personBöhm, Matthias
E-mail addressmatthias.boehm@tu-berlin.de
WebsiteNot specified

Learning outcomes

Common data and system characteristics include heterogeneous data sources and formats, often in different representations and with data quality issues (which require integration and cleaning), as well as large data collections (which require distributed data storage and analysis). Accordingly, the goals of this module are to convey a basic understanding and practical applicability of
O1 Major data integration architectures
O2 Key techniques for data integration and cleaning
O3 Methods for large-scale data storage and analysis

Content

This course covers major data integration architectures, key techniques for data integration and cleaning, as well as methods for large-scale, i.e., distributed, data storage and analysis. In detail, the module covers the following topics which also reflect the lecture calendar (with a separate 90-120min lecture per topic):

A: Data Integration and Preparation
01 Introduction and Overview
02 Data Warehousing, ETL, and SQL/OLAP
03 Message-oriented Middleware, EAI, and Replication
04 Schema Matching and Mapping
05 Entity Linking and Deduplication
06 Data Cleaning and Data Fusion
07 Data Provenance (and Blockchain)

B: Large-Scale Data Management and Analysis
08 Cloud Computing Fundamentals
09 Cloud Resource Management and Scheduling
10 Distributed Data Storage
11 Distributed, Data-Parallel Computation
12 Distributed Stream Processing
13 Distributed Machine Learning Systems

The module contains both lectures and exercises/programming projects which are offered as separate courses in order to increase flexibility.

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
Data Integration and Large-scale AnalysisLecture41112 Winter semester[en]3 ISIS
Data Integration and Large-scale AnalysisExercise41112 Winter semester[en]2 ISIS

Courses in the course catalog

Courses created from the teaching units of this module.

Winter semester 2026/27 (1)

Data Integration and Large-scale Analysis (Lecture) 1

All groups of this course in the catalog

Workload and credit points

Data Integration and Large-scale Analysis (Lecture)

Workload descriptionMultiplierHoursTotal
Attendance Lectures153 h45 h
Exam Preparation130 h30 h
Pre/post-processing Lectures151 h15 h
90 h

Data Integration and Large-scale Analysis (Exercise)

Workload descriptionMultiplierHoursTotal
Attendance Discussion Rounds32 h6 h
Exercise Prototype Implementation184 h84 h
90 h

The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.

Description of teaching and learning methods

This module combines traditional lectures (on data integration and large-scale data engineering and analysis), supporting examples of open source systems, as well as practical exercises/projects on related topics. For the practical part, teams of 1-3 students can pick one of two alternatives:
a) Contribution of a unique feature to an open-source data-centric ML system (from a list of project proposals), or
b) Alternative exercise on large-scale data analysis pipelines using Apache Spark

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

Completed basic courses on applied machine learning, data management, and distributed systems

Mandatory requirements for the module examination registration:

The examination requirements could not be retrieved.

Completion of the module

GradingGraded
Exam formatWritten exam
LanguageEnglish
Duration/Extent90 minutes

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Winter semester.

Maximum number of participants

This module is not limited to a number of students.

Registration procedures

Registration in ISIS and exercise/project selection within the first 4 weeks of the semester.

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

available – https://mboehm7.github.io/teaching/ws2122_dia/index.htm

Recommended literature

No recommended literature given

Assigned programs

This module version is used in the following programs:

Program / program versionSemester(s)Curriculum component
Computer Engineering
Computer Engineering (B. Sc.) - StuPO 2015
SS 2026Wahlpflichtbereich › Informatik
WS 2026/27Wahlpflichtbereich › Kataloge › Informatik
Computer Engineering
Computer Engineering (M. Sc.) - StuPO 2015
SS 2026Wahlpflicht Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks
WS 2026/27Wahlpflichtbereich › Studiengebiet B › Kognitive Systeme / Cognitive Systems
Computer Science
Computer Science (B. Sc.) - StuPO 2015
SS 2026Wahlpflichtbereich › Wahlpflichtbereich Katalog Informatik
WS 2026/27Wahlpflichtbereich › Katalog Informatik
Computer Science
Computer Science (B. Sc.) - StuPO 2025
WS 2026/27Wahlpflichtbereich › Studiengebiete › Datenmanagement › Weitere Module
Computer Science (Informatik)
Computer Science (Informatik) (M. Sc.) - StuPO 2015
SS 2026Studiengebiete › Verteilte Systeme und Netze / Distributed Systems and Networks
WS 2026/27Wahlpflichtbereich › Studiengebiet › Verteilte Systeme und Netze / Distributed Systems and Networks
Electrical Engineering
Electrical Engineering (M. Sc.) - StuPO 2015
SS 2026Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
WS 2026/27Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering
Industrial Engineering and Management
Industrial Engineering and Management (M. Sc.) - StuPO 2026
WS 2026/27Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering
Information Systems Management
Information Systems Management (B. Sc.) - StuPO 2015
SS 2026Wahlpflichtbereich › Informatik
WS 2026/27Wahlpflichtbereich › Informatik
Information Systems Management
Information Systems Management (B. Sc.) - StuPO 2021
SS 2026Wahlpflichtbereich › Informatik
WS 2026/27Wahlpflichtbereich › Informatik
Information Systems Management
Information Systems Management (B. Sc.) - StuPO 2025
WS 2026/27Wahlpflichtbereich › Vertiefung Informatik › Weitere Module
Information Systems Management (Wirtschaftsinformatik)
Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017
SS 2026Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering
WS 2026/27Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks

Miscellaneous

Not specified