Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

Database Internals & Scalable Data ProgrammingModule description #40398 / Version 1

← Module page Deutsche Fassung
This module description is not valid in the current semester (Winter semester 2026/27).
Module / Version#40398 / #1
ValiditySS 2014 – SS 2014
Available language(s)German
Credit points12
Person responsible for the moduleMarkl, Volker
GradingGraded
Exam formatPortfolio examination
Language(s) of instructionGerman

Affiliation

FacultyFakultät IV
InstituteInstitut für Softwaretechnik und Theoretische Informatik
Academic chair34351500 FG Datenbanksysteme und Informationsmanagement (DIMA)

Contact

OfficeEN 7
Contact personNot specified
E-mail addresssekr@dima.cs.tu-berlin.de
WebsiteNot specified

Learning outcomes

The global data volume is increasing dramatically each year. Understanding how to store, process and
manage these huge amounts of data efficiently is a key requirement for software engineers and data
analysts in the modern IT world. This course will teach students both the fundamentals of data
processing in traditional single-node database systems and how to scale out these techniques to huge amounts of data in large-scale, distributed environments.
The lecture is accompanied by an implementation project, in which students will get hands-on
experience with important data processing techniques by implementing several components of a
relational database system and by using parallel programming platforms like Apache Hadoop or
Nephele/PACT.
Technical skills: 30x; Method skills: 30x; System skills: 30x; Social competence: 10x.

Content

The lecture is split into two parts, each covering roughly one half of the semester. During the first part,
the students become acquainted with the fundamentals of query processing in traditional relational
database systems. This includes the general architecture of a DBMS, file- & buffer management,
query processing, indexing, metadata management, query optimization, locking, recovery and
transaction management. In the second half of the lecture, the basics of parallel data processing will
be covered, with a focus on large-scale, distributed systems and “cloud computing”. Topics include
parallel processing platforms like MapReduce, distributed data storage and retrieval – e.g., via DHTs –
, techniques for distributed locking and transaction handling, multi-tenancy and software as a service.
The course consists of a lecture and theoretical, written exercises.
In the project, students will implement components of a relational database system and get hands-on
experience with a parallel data processing platform. The actual components implemented may vary
each year, but will include parsing, query optimizer, execution engine, index structures and storage
system.

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
Database Internals & Scalable Data ProgrammingProject –4 ISIS
Database Internals & Scalable Data ProgrammingLecture –2 ISIS
Database Internals & Scalable Data ProgrammingExercise –2 ISIS

Workload and credit points

Database Internals & Scalable Data Programming (Project)

Workload descriptionMultiplierHoursTotal
Präsenzzeit154 h60 h
Vor-/Nachbereitung158 h120 h
180 h

Database Internals & Scalable Data Programming (Lecture)

Workload descriptionMultiplierHoursTotal
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Database Internals & Scalable Data Programming (Exercise)

Workload descriptionMultiplierHoursTotal
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

The workload of the module adds up to 360 hours. The module therefore comprises 12 credit points.

Description of teaching and learning methods

Lectures are accompanied by exercises in small groups to practically rehearse the theory taught in the
lectures. In the project, the students will be split in teams and under self-control will be implement
some components of a database system, with the goal to have a running demonstrator at the end of
the semester.
The course will be given in English.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

This course is the base course for master students with focus on database systems and information
management and should be attended in the first semester of the master program. In contrast to the
introduction of database systems (MPGI5/DBS), which looks database systems from an application
programmers point of view, this class focuses on the internals of database systems. To participate,
students are required to have successfully completed a Bachelor in computer science with a focus on
database systems (participation in the Datenbankpraktikum, Datenbankprojekt). Knowledge of data
modeling, relational algebra, and SQL as well as a very good command of Java, or possibly
C/C++/C#, programming is required to participate in the course. Due to capacity reasons, the class is
limited to at most 60 participants.

Mandatory requirements for the module examination registration:

This module has no examination requirements.

Completion of the module

GradingGraded
Exam formatPortfolio examination
LanguageGerman

Test elements

NamePoints/WeightCategoryDuration/Extent
homework10
Presentation/Demonstration of the implementation project15
Successful completion of the implementation project35
Written exam40

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Winter and summer semester.

Maximum number of participants

The maximum capacity of participants is 60.

Registration procedures

Students are required to register via the DIMA course registration tool before the start of the first
lecture (http://www.dima.tu-berlin.de/). Within the first two weeks after commencement of the lecture,
students will have to register for the course at QISPOS and ISIS in addition to the registration at the
DIMA course registration tool.

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

available – http://www.dima.cs.tu-berlin.de

Recommended literature

  • Garcia-Molina, Ullman, Widom: “Database Systems: The Complete Book,” Prentice Hall, 2000 Other Literature:
  • Härder, Rahm: “Datenbanksysteme. Konzepte und Techniken der Implementierung,” Springer, 2. Auflage 2001
  • Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom: Database Systems - The Complete Book, Pearson Education International, 2002. Or:
  • J. Gray, A. Reuter: Transaction Processing, Morgan Kaufman, 1993
  • Kemper, Eickler: “Datenbanksysteme – Eine Einführung,” Oldenburg, 5. Auflage 2004
  • R. Elmasri und S.B. Navathe: Fundamentals of Database Systems, Benjamin Cummings Deutsche Übersetzung: “Grundlagen von Datenbanksystemen,“ Pearson, 2002
  • Saake, Heuer, Sattler: “Datenbanken: Implementierungstechniken”, mitp Verlag, 2005 (2. Auflage)
  • T. Özsu und P. Valduriez: Principles of Distributed Database Systems, Prentice Hall, 1999

Assigned programs

This module is not used in any program.

Masterstudiengang Wirtschaftingenieurswesen (Studiengang IuK).

Miscellaneous

Not specified