Database Internals & Scalable Data ProgrammingModule description #40398 / Version 1
- 12 CP
- Portfolio examination
- Graded
- Winter and summer semester
- German
This module description is not valid in the current semester (Winter semester 2026/27).
| Module / Version | #40398 / #1 |
|---|---|
| Validity | SS 2014 – SS 2014 |
| Available language(s) | German |
| Credit points | 12 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | German |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | EN 7 |
|---|---|
| Contact person | Not specified |
| E-mail address | sekr@dima.cs.tu-berlin.de |
| Website | Not specified |
Learning outcomes
The global data volume is increasing dramatically each year. Understanding how to store, process and
manage these huge amounts of data efficiently is a key requirement for software engineers and data
analysts in the modern IT world. This course will teach students both the fundamentals of data
processing in traditional single-node database systems and how to scale out these techniques to huge amounts of data in large-scale, distributed environments.
The lecture is accompanied by an implementation project, in which students will get hands-on
experience with important data processing techniques by implementing several components of a
relational database system and by using parallel programming platforms like Apache Hadoop or
Nephele/PACT.
Technical skills: 30x; Method skills: 30x; System skills: 30x; Social competence: 10x.
manage these huge amounts of data efficiently is a key requirement for software engineers and data
analysts in the modern IT world. This course will teach students both the fundamentals of data
processing in traditional single-node database systems and how to scale out these techniques to huge amounts of data in large-scale, distributed environments.
The lecture is accompanied by an implementation project, in which students will get hands-on
experience with important data processing techniques by implementing several components of a
relational database system and by using parallel programming platforms like Apache Hadoop or
Nephele/PACT.
Technical skills: 30x; Method skills: 30x; System skills: 30x; Social competence: 10x.
Content
The lecture is split into two parts, each covering roughly one half of the semester. During the first part,
the students become acquainted with the fundamentals of query processing in traditional relational
database systems. This includes the general architecture of a DBMS, file- & buffer management,
query processing, indexing, metadata management, query optimization, locking, recovery and
transaction management. In the second half of the lecture, the basics of parallel data processing will
be covered, with a focus on large-scale, distributed systems and “cloud computing”. Topics include
parallel processing platforms like MapReduce, distributed data storage and retrieval – e.g., via DHTs –
, techniques for distributed locking and transaction handling, multi-tenancy and software as a service.
The course consists of a lecture and theoretical, written exercises.
In the project, students will implement components of a relational database system and get hands-on
experience with a parallel data processing platform. The actual components implemented may vary
each year, but will include parsing, query optimizer, execution engine, index structures and storage
system.
the students become acquainted with the fundamentals of query processing in traditional relational
database systems. This includes the general architecture of a DBMS, file- & buffer management,
query processing, indexing, metadata management, query optimization, locking, recovery and
transaction management. In the second half of the lecture, the basics of parallel data processing will
be covered, with a focus on large-scale, distributed systems and “cloud computing”. Topics include
parallel processing platforms like MapReduce, distributed data storage and retrieval – e.g., via DHTs –
, techniques for distributed locking and transaction handling, multi-tenancy and software as a service.
The course consists of a lecture and theoretical, written exercises.
In the project, students will implement components of a relational database system and get hands-on
experience with a parallel data processing platform. The actual components implemented may vary
each year, but will include parsing, query optimizer, execution engine, index structures and storage
system.
Module components
Compulsory area
The following courses are mandatory for this module:
Workload and credit points
Database Internals & Scalable Data Programming (Project)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Präsenzzeit | 15 | 4 h | 60 h |
| Vor-/Nachbereitung | 15 | 8 h | 120 h |
| 180 h | |||
Database Internals & Scalable Data Programming (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Database Internals & Scalable Data Programming (Exercise)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
The workload of the module adds up to 360 hours. The module therefore comprises 12 credit points.
Description of teaching and learning methods
Lectures are accompanied by exercises in small groups to practically rehearse the theory taught in the
lectures. In the project, the students will be split in teams and under self-control will be implement
some components of a database system, with the goal to have a running demonstrator at the end of
the semester.
The course will be given in English.
lectures. In the project, the students will be split in teams and under self-control will be implement
some components of a database system, with the goal to have a running demonstrator at the end of
the semester.
The course will be given in English.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
This course is the base course for master students with focus on database systems and information
management and should be attended in the first semester of the master program. In contrast to the
introduction of database systems (MPGI5/DBS), which looks database systems from an application
programmers point of view, this class focuses on the internals of database systems. To participate,
students are required to have successfully completed a Bachelor in computer science with a focus on
database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data
modeling, relational algebra, and SQL as well as a very good command of Java, or possibly
C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is
limited to at most 60 participants.
management and should be attended in the first semester of the master program. In contrast to the
introduction of database systems (MPGI5/DBS), which looks database systems from an application
programmers point of view, this class focuses on the internals of database systems. To participate,
students are required to have successfully completed a Bachelor in computer science with a focus on
database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data
modeling, relational algebra, and SQL as well as a very good command of Java, or possibly
C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is
limited to at most 60 participants.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Language | German |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| homework | 10 | ||
| Presentation/Demonstration of the implementation project | 15 | ||
| Successful completion of the implementation project | 35 | ||
| Written exam | 40 |
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter and summer semester.
Maximum number of participants
The maximum capacity of participants is 60.
Registration procedures
Students are required to register via the DIMA course registration tool before the start of the first
lecture (http://www.dima.tu-berlin.de/). Within the first two weeks after commencement of the lecture,
students will have to register for the course at QISPOS and ISIS in addition to the registration at the
DIMA course registration tool.
lecture (http://www.dima.tu-berlin.de/). Within the first two weeks after commencement of the lecture,
students will have to register for the course at QISPOS and ISIS in addition to the registration at the
DIMA course registration tool.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – http://www.dima.cs.tu-berlin.de
Recommended literature
- Garcia-Molina, Ullman, Widom: “Database Systems: The Complete Book,” Prentice Hall, 2000 Other Literature:
- Härder, Rahm: “Datenbanksysteme. Konzepte und Techniken der Implementierung,” Springer, 2. Auflage 2001
- Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom: Database Systems - The Complete Book, Pearson Education International, 2002. Or:
- J. Gray, A. Reuter: Transaction Processing, Morgan Kaufman, 1993
- Kemper, Eickler: “Datenbanksysteme – Eine Einführung,” Oldenburg, 5. Auflage 2004
- R. Elmasri und S.B. Navathe: Fundamentals of Database Systems, Benjamin Cummings Deutsche Übersetzung: “Grundlagen von Datenbanksystemen,“ Pearson, 2002
- Saake, Heuer, Sattler: “Datenbanken: Implementierungstechniken”, mitp Verlag, 2005 (2. Auflage)
- T. Özsu und P. Valduriez: Principles of Distributed Database Systems, Prentice Hall, 1999
Assigned programs
This module is not used in any program.
Masterstudiengang Wirtschaftingenieurswesen (Studiengang IuK).
Miscellaneous
Not specified