DMH Data Management on Modern HardwareModule description #40804 / Version 6
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- English
| Module / Version | #40804 / #6 |
|---|---|
| Validity | Since Summer semester 2024 |
| Available language(s) | English, German |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | FR 7-1 |
|---|---|
| Contact person | Zeuch, Steffen |
| E-mail address | sekr@tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
Traditionally, database systems managed databases that were primarily stored on secondary storage and only a small part of the data could fit in main memory. Therefore, disk IO was the dominating cost factor. Nowadays, it is possible to equip servers with several terabytes of main memory, which allows us to keep databases in main memory to avoid the disk IO bottleneck. Hence, the performance of database systems became limited by memory access and processing power. This course will teach students the fundamentals of efficient data processing in main-memory database systems using techniques optimized for main memory (e.g., column stores and query compilation) and modern processor capabilities (e.g., SIMD-based database algorithms, GPU co-processing).
Content
The course is split into two parts, each covering roughly one half of the semester. During the first part, the students learn the fundamentals of cache-efficient storage and processing models. This includes columnar storage and query processing, compression, vector-at-a-time processing, query compilation and transaction processing. In the second part, students learn the basics of parallel data processing on modern CPUs and co-processors (e.g., GPUs) for typical database operators, including optimizations such as SIMD and NUMA-awareness.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| In-Memory Databases On Modern Hardware | Integrated course | 3435 L 9195 | Summer semester | – | 4 | ISIS |
Workload and credit points
In-Memory Databases On Modern Hardware (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Participating in Meetings | 15 | 4 h | 60 h |
| 60 h | |||
Course-independent workload
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Exam preparation | 1 | 30 h | 30 h |
| Graded problem sheets | 1 | 60 h | 60 h |
| Self-assessment Database Technology | 15 | 2 h | 30 h |
| 120 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
Lectures are accompanied by individual exercises to practically rehearse the theory taught in the lectures.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Desirable prerequisites for participation in the courses:
This course is an advanced course for master’s students with focus on database systems and information management.
In contrast to the introduction of database systems (ISDA Informationssysteme und Datenanalyse), which looks at database systems from an application programmer’s point of view, this class focuses on the data management systems and various optimizations for efficient query processing on modern hardware.
It is desirable for students to have completed the Database Technology (DBT) prior to enrolling in DMH.
It is also desirable for students to have successfully completed a Bachelor’s degree in computer science with a focus on database systems (e.g., DBPRA Datenbankpraktikum, DBPRO Datenbankprojekt).
In addition, knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is desirable.
This course is an advanced course for master’s students with focus on database systems and information management.
In contrast to the introduction of database systems (ISDA Informationssysteme und Datenanalyse), which looks at database systems from an application programmer’s point of view, this class focuses on the data management systems and various optimizations for efficient query processing on modern hardware.
It is desirable for students to have completed the Database Technology (DBT) prior to enrolling in DMH.
It is also desirable for students to have successfully completed a Bachelor’s degree in computer science with a focus on database systems (e.g., DBPRA Datenbankpraktikum, DBPRO Datenbankprojekt).
In addition, knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is desirable.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | German |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Assessment of 4 homework exercises with 5 pts | 20 | written | 4 x15h = 60h |
| (Examination) Quiz 1: (Mid term) | 40 | written | 60 min |
| (Examination) Quiz 2: (End-of-term) | 40 | written | 60 min |
Exam description
The final grade according to § 68 (2) AllgStuPO will be calculated with the faculty grading table 2.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
Admission to the lecture is limited. Please have a look at https://www.tu.berlin/dima/studium-lehre/kursangebote before the lecture period starts to get information on how you can register.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Alfons Kemper, André Eickler Datenbanksysteme. Eine Einführung.10., aktualisierte und erweiterte Auflage, Oldenbourg Verlag, 2015.
- Daniel Abadi, Peter A. Boncz, Stavros Harizopoulos, Stratos Idreos, Samuel Madden: The Design and Implementation of Modern Column-Oriented Database Systems. Foundations and Trends in Databases 5(3): 197-280 (2013)
- Hasso Plattner. 2014. A Course in In-Memory Data Management: The Inner Mechanics of In-Memory Databases. Second Edition. Springer Publishing Company, Incorporated.
- John L. Hennessy, and David A. Patterson. Computer architecture: a quantitative approach. Elsevier, 2012.
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflicht Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| SS 2026 | Wahlpflicht Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet B › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2025 | Wahlpflicht Studiengebiete Fak. IV › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2024 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
| WS 2024/25 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| SS 2025 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| WS 2025/26 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| SS 2026 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| WS 2026/27 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | SS 2025 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks |
| WS 2025/26 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks | |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Verteilte Systeme und Netze / Distributed Systems and Networks |
Miscellaneous
Not specified