Data Management on Modern HardwareModule description #40804 / Version 2
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
Current version (v6)
| Module / Version | #40804 / #2 |
|---|---|
| Validity | Summer semester 2021 – Summer semester 2021 |
| Available language(s) | English, German |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | FR 7-1 |
|---|---|
| Contact person | Zeuch, Steffen |
| E-mail address | sekr@tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
Traditionally, database systems managed databases that were primarily stored on secondary storage and only a small part of the data could fit in main memory. Therefore, disk I/O was the dominating cost factor. Nowadays, it is possible to equip servers with several terabytes of main memory, which allows us to keep databases in main memory to avoid the disk I/O bottleneck. Therefore, the performance of database systems became limited by memory access and processing power. This course will teach students the fundamentals of efficient data processing in main-memory database systems using techniques optimized for main memory (e.g., column stores and query compilation) and modern processor capabilities (e.g., SIMD-based database algorithms, GPU co-processing).
Furthermore, this course will also teach how other data management systems beyond relational databases exploit modern hardware to speed-up processing.
Furthermore, this course will also teach how other data management systems beyond relational databases exploit modern hardware to speed-up processing.
Content
The course is split into two parts, each covering roughly one half of the semester. During the first part, the students learn the fundamentals of cache-efficient storage and processing models. This includes columnar storage and query processing, compression, vector-at-a-time processing, query compilation, and transaction processing. In the second part, students learn the basics of parallel data processing on modern CPUs and co-processors (e.g., GPUs) for typical database operators, including optimizations such as SIMD and NUMA-awareness. Furthermore, the second part will also introduce optimizations for operators that go beyond relational algebra. The course consists of a lecture and theoretical, written exercises.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| In-Memory Databases On Modern Hardware | Integrated course | 3435 L 9195 | Summer semester | – | 4 | ISIS |
Workload and credit points
In-Memory Databases On Modern Hardware (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 4 h | 60 h |
| 60 h | |||
Course-independent workload
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Exam preparation | 1 | 30 h | 30 h |
| Graded problem sheets | 1 | 60 h | 60 h |
| Preparation/Consolidation IDB | 15 | 2 h | 30 h |
| 120 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
Lectures are accompanied by individual exercises to practically rehearse the theory taught in the lectures.
The course will be given in English.
The course will be given in English.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
This course is an advanced course for master students with focus on database systems and information management. In contrast to the introduction of database systems (MPGI5/DBS/Informationssystemse&Datenanalyse), which looks at database systems from an application programmers point of view, this class focuses on the internals of in-memory database systems and various optimizations for efficient query processing on modern hardware. It is useful (but not required) to attend the course Database Technology (DBT) prior to this course.
To participate, students are required to have successfully completed a Bachelor in computer science with a focus on database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is limited to at most 60 participants.
To participate, students are required to have successfully completed a Bachelor in computer science with a focus on database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is limited to at most 60 participants.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Assessment of 4 homework exercises with 5 pts | 20 | written | 4x15h = 60h |
| (Examination) End term test | 40 | written | 60 min |
| (Examination) Mid term test | 40 | written | 60 min |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 60.
Registration procedures
Students are required to register via the DIMA course registration tool before the start of the first lecture (http://www.dima.tu-berlin.de/).
Within the first six weeks after commencement of the lecture, students will have to register for the course at QISPOS (university examination protocol tool) and ISIS (course organization tool) in addition to the registration at the DIMA course registration tool.
Within the first six weeks after commencement of the lecture, students will have to register for the course at QISPOS (university examination protocol tool) and ISIS (course organization tool) in addition to the registration at the DIMA course registration tool.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Alfons Kemper, André Eickler Datenbanksysteme. Eine Einführung.10., aktualisierte und erweiterte Auflage, Oldenbourg Verlag, 2015.
- Daniel Abadi, Peter A. Boncz, Stavros Harizopoulos, Stratos Idreos, Samuel Madden: The Design and Implementation of Modern Column-Oriented Database Systems. Foundations and Trends in Databases 5(3): 197-280 (2013)
- Hasso Plattner. 2014. A Course in In-Memory Data Management: The Inner Mechanics of In-Memory Databases. Second Edition. Springer Publishing Company, Incorporated.
- John L. Hennessy, and David A. Patterson. Computer architecture: a quantitative approach. Elsevier, 2012.
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2021 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Distributed Systems and Networks |
Miscellaneous
Not specified