Database Internals & Scalable Data ProcessingModule description #40405 / Version 2
- 6 CP
- Portfolio examination
- Graded
- Winter semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
Current version (v13)
| Module / Version | #40405 / #2 |
|---|---|
| Validity | SS 2014 – SS 2015 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | FR 7-1 |
|---|---|
| Contact person | Zeuch, Steffen |
| E-mail address | sekr@dima.tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
The global data volume is increasing dramatically each year. Understanding how to store, process and manage these huge amounts of data efficiently is a key requirement for software engineers and data analysts in the modern IT world. This course will teach students both the fundamentals of data processing in traditional single-node database systems and how to scale out these techniques to huge amounts of data in large-scale, distributed environments.
Technical skills: 30%; Method skills: 30%; System skills: 30%; Social competence: 10%.
Technical skills: 30%; Method skills: 30%; System skills: 30%; Social competence: 10%.
Content
The lecture is split into two parts, each covering roughly one half of the semester. During the first part, the students become acquainted with the fundamentals of query processing in traditional relational database systems. This includes the general architecture of a DBMS, file- & buffer management, query processing, indexing, metadata management, query optimization, locking, recovery and transaction management. In the second half of the lecture, the basics of parallel data processing will be covered with a focus on large-scale, distributed systems and “cloud computing”. Topics include parallel processing platforms like MapReduce, distributed data storage and retrieval – e.g., via DHTs –, techniques for distributed locking and transaction handling, multi-tenancy and software as a service. The course consists of a lecture and theoretical, written exercises. An additional practice project in conjunction with this lecture is offered and recommended to be taken in parallel.
Module components
Compulsory area
The following courses are mandatory for this module:
Workload and credit points
IDB: Implementation of Database Systems and Scalable Data Processing (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Participation in class IDB | 15 | 2 h | 30 h |
| 30 h | |||
IDB: Implementation of Database Systems and Scalable Data Processing (Exercise)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Participation in exercises IDB | 15 | 2 h | 30 h |
| 30 h | |||
Course-independent workload
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Exam preparation | 1 | 30 h | 30 h |
| Graded problem sheets | 1 | 60 h | 60 h |
| Preparation/Consolidation IDB | 15 | 2 h | 30 h |
| 120 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
Lectures are accompanied by exercises in small groups to practically rehearse the theory taught in the lectures.
The course will be given in English.
The course will be given in English.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
This course is the base course for master students with focus on database systems and information management and should be attended in the first semester of the master program. In contrast to the introduction of database systems (MPGI5/DBS), which looks at database systems from an application programmers point of view, this class focuses on the internals of database systems. To participate, students are required to have successfully completed a Bachelor in computer science with a focus on database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data modeling, relational algebra, and SQL as well as a very good command of Java, or possibly C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is limited to at most 60 participants.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| Assessment of the homework exercises | 20 | ||
| Result of the written exam | 80 |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter semester.
Maximum number of participants
The maximum capacity of participants is 60.
Registration procedures
Not specified
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- [1] Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom: Database Systems - The Complete Book, Pearson Education International, 2002. Or:
- [2] Garcia-Molina, Ullman, Widom: “Database Systems: The Complete Book,” Prentice Hall, 2000.
- [3] R. Elmasri und S.B. Navathe: Fundamentals of Database Systems, Benjamin Cummings Deutsche Übersetzung: “Grundlagen von Datenbanksystemen,“ Pearson, 2002.
- [4] J. Gray, A. Reuter: Transaction Processing, Morgan Kaufman, 1993.
- [5] T. Özsu und P. Valduriez: Principles of Distributed Database Systems, Prentice Hall, 1999.
- [6] Saake, Heuer, Sattler: “Datenbanken: Implementierungstechniken”, mitp Verlag, 2005 (2. Auflage).
- [7] Härder, Rahm: “Datenbanksysteme. Konzepte und Techniken der Implementierung,” Springer, 2. Auflage 2001.
- [8] Kemper, Eickler: “Datenbanksysteme – Eine Einführung,” Oldenburg, 5. Auflage 2004.
Assigned programs
This module is not used in any program.
Miscellaneous
Not specified