Skip to content
Technische Universität Berlin Deutsch
Course catalog and module transfer system

MDS Management of Data StreamsModule description #40310 / Version 7

← Module page Deutsche Fassung
This module description is not valid in the current semester (Winter semester 2026/27). Current version (v8)
Module / Version#40310 / #7
ValiditySummer semester 2022 – Winter semester 2022/23
Available language(s)English
Credit points6
Person responsible for the moduleMarkl, Volker
GradingGraded
Exam formatPortfolio examination
Language(s) of instructionEnglish

Affiliation

FacultyFakultät IV
InstituteInstitut für Softwaretechnik und Theoretische Informatik
Academic chair34351500 FG Datenbanksysteme und Informationsmanagement (DIMA)

Contact

OfficeFR 7-1
Contact personBorusan, Alexander
E-mail addresssekr@dima.tu-berlin.de
Websitehttps://www.tu.berlin/dima

Learning outcomes

Through the technological advances in the last few years more and more applications are being created that constantly generate data which is only relevant for a certain time frame. Because of this, this type of application has to be able to handle various streams of data.
You will gain conceptual, methodological and practical skills in the area of processing data streams, by using examples from various application areas.

Content

In recent years, advances in hardware technology have facilitated new ways of collecting data continuously. In many applications such as for instance network monitoring, the volume of such data is so large that it may be impossible to store the data on disk. Furthemore, even when the data can be stored, the volume of the incoming data may be so large that it may be impossible to process any particular record more than once. Therefore, many database operations and data analysis algorithms such as for instance filtering, indexing, classification and clustering become significantly more challenging in this context.
The course has the following main topics:
- Basic conceptual understanding and terminology of data streams management, introduction to data streams, the difference to classical data management, examples (telephone networks, automotive electronics, avionics, medical, transport management, building monitoring, etc.)
- Basic concepts of technical information systems, modeling of data streams
- Data sources, requirements elicitation, requirements structuring, requirements of data stream management systems (DSMS)
- Reference architecture of a DSMS, architecture modeling
- Modeling of the functionality, logical architecture. Description on technical architecture, interface definition, behavior modeling
- Data streams processing: Windowing, The Sliding-Window Computation Model and Results
- Synopsis Construction in Data Streams (Sampling, Wavelets, Sketches and Histograms)
- Filtering, counting in data streams
- Data streams analysis: Classification & Clustering
- Data processing in sensor networks, resource utilization, transmission and transfer costs
- Modeling examples (automotive electronics, avionics). Prototype Systems (Aurora, STREAM, TelegraphCQ). Frameworks (Flink, Spark, Storm, Samza, SAMOA)

Module components

Compulsory area

The following courses are mandatory for this module:

CoursesTypeNumberFrequencyLanguageHours per weekCourse catalog
Management of Data StreamsIntegrated course0434 L 471 Winter semester[en]4 ISIS

Courses in the course catalog

Courses created from the teaching units of this module.

Winter semester 2026/27 (1)

Management of Data Streams (Integrated course) 1

All groups of this course in the catalog

Workload and credit points

Management of Data Streams (Integrated course)

Workload descriptionMultiplierHoursTotal
Lecture152 h30 h
Labs / Project Work154 h60 h
Study of Materials152 h30 h
Seminar Presentations + Reporting154 h60 h
180 h

The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.

Description of teaching and learning methods

MDS Management of Data Streams consists of 4 teaching elements: lectures, in parallel integrated phases of student presentations (individual work) and labs work (group projects plus homework), plus intensive study of literature.

Requirements for participation and examination

Desirable prerequisites for participation in the courses:

BSc in Computer Science / Computer Engineering (or similar); good knowledge in 'Databases & Information Systems', 'Software Engineering', and Mathematics

Mandatory requirements for the module examination registration:

This module has no examination requirements.

Completion of the module

GradingGraded
Exam formatPortfolio examination
Type of portfolio examination100 points in total
LanguageEnglish

Test elements

NamePoints/WeightCategoryDuration/Extent
(Deliverable assessment) Project Work/Homework (small teams = 3 max)20practical30 hours
(Deliverable assessment) Written Project Report35written20 pages
(Deliverable assessment) Written Seminar Report (individual)15written8-10 pages
(Learning process review) Seminar Talk (individual)30oral20-30 minutes

Exam description

The exam of this module consists of 4 portfolio elements:
3 'deliverable assessements' ("Ergebnisprüfungen"): seminar talk, seminar report, and project report
plus one 'learning process review' ("Lernprozess-Evaluierung"): project (lab & home) work evaluation

Duration of the module

The following number of semesters is estimated for taking and completing the module: 1 semester(s).

This module can be started in the following semesters: Winter semester.

Maximum number of participants

The maximum capacity of participants is 30.

Registration procedures

Students are required to register for the course in the official TUB examination system within six weeks after commencement of the first lecture or when the first graded assignment is due, whichever happens to be first

Recommended reading, lecture notes

Lecture notes

unavailable

Electronic lecture notes

unavailable

Recommended literature

  • Data Streams: Models and Algorithms, Edited by Charu C. Aggarwal, Kluwer Academic 2007. http://charuaggarwal.net/streambook.pdf
  • Mining of Massive Datasets (3rd Edition), A. Rajaraman, J. Ullman, Cambridge 2019. http://mmds.org/

Assigned programs

This module version is used in the following programs:

Program / program versionSemester(s)Curriculum component
Industrial Engineering and Management
Industrial Engineering and Management (M. Sc.) - StuPO 2015
SS 2022Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering
WS 2022/23Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering

Miscellaneous

Not specified