MDS Management of Data StreamsModule description #40310 / Version 8
- 6 CP
- Oral exam
- Graded
- Winter semester
- English
| Module / Version | #40310 / #8 |
|---|---|
| Validity | Since Winter semester 2025/26 |
| Available language(s) | English, German |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Oral exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | FR 7-1 |
|---|---|
| Contact person | Borusan, Alexander |
| E-mail address | sekr@dima.tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
Through the technological advances in the last few years more and more applications are being created that constantly generate data which is only relevant for a certain time frame. Because of this, this type of application has to be able to handle various streams of data. You will gain conceptual, methodological and practical skills in the area of processing data streams, by using examples from various application areas. You are qualified to choose, to customise, to use the algorithms of data streams processing, and to develop the architecture of data streams management systems for medium-sized applications.
Content
In recent years, advances in hardware technology have facilitated new ways of collecting data continuously. In many applications such as for instance network monitoring, the volume of such data is so large that it may be impossible to store the data on disk. Furthemore, even when the data can be stored, the volume of the incoming data may be so large that it may be impossible to process any particular record more than once. Therefore, many database operations and data analysis algorithms such as for instance filtering, indexing, classification and clustering become significantly more challenging in this context.
The course has the following main topics:
- Basic conceptual understanding and terminology of data streams management, introduction to data streams, examples (telephone networks, automotive electronics, avionics, transport management, building monitoring, etc.)
- Basic concepts of technical information systems, modeling of data streams
- Data sources, requirements structuring, requirements of data stream management systems (DSMS)
- Reference architecture of a DSMS, architecture modeling
- Modeling of the functionality, logical architecture. Description on technical architecture, interface definition, behavior modeling
- Data streams processing: Windowing, The Sliding-Window Computation Model and Results
- Synopsis Construction in Data Streams (Sampling, Wavelets, Sketches and Histograms)
- Filtering and counting in data streams
- Data streams analysis: Classification & Clustering
- Modeling examples (automotive electronics, avionics)
- Prototype Systems (Aurora, STREAM, TelegraphCQ)
- Frameworks (Flink, Spark, Storm)
The course has the following main topics:
- Basic conceptual understanding and terminology of data streams management, introduction to data streams, examples (telephone networks, automotive electronics, avionics, transport management, building monitoring, etc.)
- Basic concepts of technical information systems, modeling of data streams
- Data sources, requirements structuring, requirements of data stream management systems (DSMS)
- Reference architecture of a DSMS, architecture modeling
- Modeling of the functionality, logical architecture. Description on technical architecture, interface definition, behavior modeling
- Data streams processing: Windowing, The Sliding-Window Computation Model and Results
- Synopsis Construction in Data Streams (Sampling, Wavelets, Sketches and Histograms)
- Filtering and counting in data streams
- Data streams analysis: Classification & Clustering
- Modeling examples (automotive electronics, avionics)
- Prototype Systems (Aurora, STREAM, TelegraphCQ)
- Frameworks (Flink, Spark, Storm)
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Management of Data Streams | Integrated course | 0434 L 471 | Winter semester | [en] | 4 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (1)
Management of Data Streams (Integrated course) 1
- Management of Data Streams (Integrierte Veranstaltung) Termingruppe 1 0434 L 471
Workload and credit points
Management of Data Streams (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Working on Exercises/practical part (case study) | 15 | 3 h | 45 h |
| Exam preparation | 1 | 30 h | 30 h |
| Participation in the course | 15 | 3 h | 45 h |
| Preparation and follow-up (reading and study of the primary literature) | 15 | 4 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
This integrated course consists of a lecture part and an exercise and practical part, which consists of small and larger tasks and is worked on in small teams (including presentations).
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
good knowledge in 'Databases & Information Systems', 'Software Engineering', and Mathematics.
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Oral exam |
| Language | English |
| Duration/Extent | 25 minutes |
Exam description
Topics from the integrated course are dealt with in the oral examination. Explicit reference is made to examples covered during the semester.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
Admission to the lecture is limited. Please take a look at https://www.tu.berlin/dima/studium-lehre/kursangebote before the lecture period starts to get information on how you can register.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Data Stream Management. Processing High-Speed Data Streams. Ed. by M.Garofalakis, J.Gehrke, R.Rastogi, Springer, 2016, ISBN: 978-3-540-28608-0
- Data Streams: Models and Algorithms, Edited by Charu C. Aggarwal, Kluwer Academic 2007. http://charuaggarwal.net/streambook.pdf
- Knowledge Discovery from Data Streams. Ed. by Joao Gama. CRC Press, 2010, ISBN: 978-1439826119
- Mining of Massive Datasets (3rd Edition), A. Rajaraman, J. Ullman, Cambridge University Press, January 2020. http://mmds.org/
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | WS 2025/26 | Studiengebiete › Data and Software Engineering / Data and Software Engineering |
| SS 2026 | Studiengebiete › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Data and Software Engineering / Data and Software Engineering | |
| Digital Media and Technology Digital Media and Technology (M. Sc.) - StuPO 2017 | WS 2025/26 | Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Data Science |
| SS 2026 | Wahlpflichtbereich › Technische Profilbereiche (A) › Profilbereich Data Science | |
| WS 2026/27 | Wahlpflichtbereich › Technische Profilbereiche (A) › Data Science | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | WS 2025/26 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering |
| SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Data and Software Engineering / Data and Software Engineering | |
| ICT Innovation ICT Innovation (M. Sc.) - StuPO 2020 | WS 2025/26 | Studienrichtungen › Major: Data Science › Exit year: Data Science › Exit year Electives: Data Science |
| SS 2026 | Studienrichtungen › Major: Data Science › Exit year: Data Science › Exit year Electives: Data Science | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | WS 2025/26 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
| SS 2026 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| WS 2026/27 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › AI Engineering › Data and Software Engineering |
| Information Systems Management (Wirtschaftsinformatik) Information Systems Management (Wirtschaftsinformatik) (M. Sc.) - StuPO 2017 | WS 2025/26 | Wahlpflichtbereich › Fachstudium Wirtschaftsinformatik › Informationssysteme / Information Systems |
| SS 2026 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| WS 2026/27 | Wahlpflichtbereich › Fachstudium Informatik › Data and Software Engineering | |
| Media Technology Media Technology (M. Sc.) - StuPO 2022 | WS 2025/26 | Wahlpflicht weitere Profibereiche › weiterer Profilbereich Data Science |
| SS 2026 | Wahlpflichtbereich Profilbereiche › Profilbereich Data Science | |
| WS 2026/27 | Wahlpflichtbereich › Profilbereich › Data Science |
Miscellaneous
Not specified