Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

Data Management on Modern HardwareModule description #40804 / Version 2

← Module page Deutsche Fassung
This module description is not valid in the current semester (Winter semester 2026/27). Current version (v6)
Module / Version#40804 / #2
ValiditySummer semester 2021 – Summer semester 2021
Available language(s)English, German
Credit points6
Person responsible for the moduleMarkl, Volker
GradingGraded
Exam formatPortfolio examination
Language(s) of instructionEnglish

Affiliation

FacultyFakultät IV
InstituteInstitut für Softwaretechnik und Theoretische Informatik
Academic chair34351500 FG Datenbanksysteme und Informationsmanagement (DIMA)

Contact

OfficeFR 7-1
Contact personZeuch, Steffen
E-mail addresssekr@tu-berlin.de
Websitehttps://www.tu.berlin/dima

Learning outcomes

Traditionally, database systems managed databases that were primarily stored on secondary storage and only a small part of the data could fit in main memory. Therefore, disk I/O was the dominating cost factor. Nowadays, it is possible to equip servers with several terabytes of main memory, which allows us to keep databases in main memory to avoid the disk I/O bottleneck. Therefore, the performance of database systems became limited by memory access and processing power. This course will teach students the fundamentals of efficient data processing in main-memory database systems using techniques optimized for main memory (e.g., column stores and query compilation) and modern processor capabilities (e.g., SIMD-based database algorithms, GPU co-processing).
Furthermore, this course will also teach how other data management systems beyond relational databases exploit modern hardware to speed-up processing.

Content

The course is split into two parts, each covering roughly one half of the semester. During the first part, the students learn the fundamentals of cache-efficient storage and processing models. This includes columnar storage and query processing, compression, vector-at-a-time processing, query compilation, and transaction processing. In the second part, students learn the basics of parallel data processing on modern CPUs and co-processors (e.g., GPUs) for typical database operators, including optimizations such as SIMD and NUMA-awareness. Furthermore, the second part will also introduce optimizations for operators that go beyond relational algebra. The course consists of a lecture and theoretical, written exercises.

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
In-Memory Databases On Modern HardwareIntegrated course3435 L 9195 Summer semester–4 ISIS

Workload and credit points

In-Memory Databases On Modern Hardware (Integrated course)

Workload descriptionMultiplierHoursTotal
Attendance154 h60 h
60 h

Course-independent workload

Workload descriptionMultiplierHoursTotal
Exam preparation130 h30 h
Graded problem sheets160 h60 h
Preparation/Consolidation IDB152 h30 h
120 h

The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.

Description of teaching and learning methods

Lectures are accompanied by individual exercises to practically rehearse the theory taught in the lectures.
The course will be given in English.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

This course is an advanced course for master students with focus on database systems and information management. In contrast to the introduction of database systems (MPGI5/DBS/Informationssystemse&Datenanalyse), which looks at database systems from an application programmers point of view, this class focuses on the internals of in-memory database systems and various optimizations for efficient query processing on modern hardware. It is useful (but not required) to attend the course Database Technology (DBT) prior to this course.
To participate, students are required to have successfully completed a Bachelor in computer science with a focus on database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is limited to at most 60 participants.

Mandatory requirements for the module examination registration:

This module has no examination requirements.

Completion of the module

GradingGraded
Exam formatPortfolio examination
Type of portfolio examination100 points in total
LanguageEnglish

Test elements

NamePoints/WeightCategoryDuration/Extent
(Deliverable assessment) Assessment of 4 homework exercises with 5 pts20written4x15h = 60h
(Examination) End term test40written60 min
(Examination) Mid term test40written60 min

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Summer semester.

Maximum number of participants

The maximum capacity of participants is 60.

Registration procedures

Students are required to register via the DIMA course registration tool before the start of the first lecture (http://www.dima.tu-berlin.de/).
Within the first six weeks after commencement of the lecture, students will have to register for the course at QISPOS (university examination protocol tool) and ISIS (course organization tool) in addition to the registration at the DIMA course registration tool.

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

unavailable

Recommended literature

  • Alfons Kemper, André Eickler Datenbanksysteme. Eine Einführung.10., aktualisierte und erweiterte Auflage, Oldenbourg Verlag, 2015.
  • Daniel Abadi, Peter A. Boncz, Stavros Harizopoulos, Stratos Idreos, Samuel Madden: The Design and Implementation of Modern Column-Oriented Database Systems. Foundations and Trends in Databases 5(3): 197-280 (2013)
  • Hasso Plattner. 2014. A Course in In-Memory Data Management: The Inner Mechanics of In-Memory Databases. Second Edition. Springer Publishing Company, Incorporated.
  • John L. Hennessy, and David A. Patterson. Computer architecture: a quantitative approach. Elsevier, 2012.

Assigned programs

This module version is used in the following programs:

Program / program versionSemester(s)Curriculum component
Industrial Engineering and Management
Industrial Engineering and Management (M. Sc.) - StuPO 2015
SS 2021Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Distributed Systems and Networks

Miscellaneous

Not specified