Advanced Information Management 2 - Management of Data StreamsModule description #40310 / Version 5
- 6 CP
- Portfolio examination
- Graded
- Winter semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
Current version (v8)
| Module / Version | #40310 / #5 |
|---|---|
| Validity | Summer semester 2020 – Winter semester 2021/22 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | FR 7-1 |
|---|---|
| Contact person | Borusan, Alexander |
| E-mail address | sekr@dima.tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
Through the technological advances in the last few years more and more applications are being created that constantly generate data which is only relevant for a certain time frame. Because of this, this type of application has to be able to handle various streams of data.
You will gain conceptual, methodological and practical skills in the area of processing data streams, by using examples from various application areas.
You will gain conceptual, methodological and practical skills in the area of processing data streams, by using examples from various application areas.
Content
In recent years, advances in hardware technology have facilitated new ways of collecting data continuously. In many applications such as for instance network monitoring, the volume of such data is so large that it may be impossible to store the data on disk. Furthemore, even when the data can be stored, the volume of the incoming data may be so large that it may be impossible to process any particular record more than once. Therefore, many database operations and data analysis algorithms such as for instance filtering, indexing, classification and clustering become significantly more challenging in this context.
The course has the following main topics:
- Basic conceptual understanding and terminology of data streams management, introduction to data streams, the difference to classical data management, examples (telephone networks, automotive electronics, avionics, medical, transport management, building monitoring, etc.)
- Basic concepts of technical information systems, modeling of data streams
- Data sources, requirements elicitation, requirements structuring, requirements of data stream management systems (DSMS)
- Reference architecture of a DSMS, architecture modeling
- Modeling of the functionality, logical architecture. Description on technical architecture, interface definition, behavior modeling
- Data streams processing: Windowing, The Sliding-Window Computation Model and Results
- Synopsis Construction in Data Streams (Sampling, Wavelets, Sketches and Histograms)
- Filtering, counting in data streams
- Data streams analysis: Classification & Clustering
- Data processing in sensor networks, resource utilization, transmission and transfer costs
- Modeling examples (automotive electronics, avionics). Prototype Systems (Aurora, STREAM, TelegraphCQ). Frameworks (Flink, Spark, Storm, Samza, SAMOA)
The course has the following main topics:
- Basic conceptual understanding and terminology of data streams management, introduction to data streams, the difference to classical data management, examples (telephone networks, automotive electronics, avionics, medical, transport management, building monitoring, etc.)
- Basic concepts of technical information systems, modeling of data streams
- Data sources, requirements elicitation, requirements structuring, requirements of data stream management systems (DSMS)
- Reference architecture of a DSMS, architecture modeling
- Modeling of the functionality, logical architecture. Description on technical architecture, interface definition, behavior modeling
- Data streams processing: Windowing, The Sliding-Window Computation Model and Results
- Synopsis Construction in Data Streams (Sampling, Wavelets, Sketches and Histograms)
- Filtering, counting in data streams
- Data streams analysis: Classification & Clustering
- Data processing in sensor networks, resource utilization, transmission and transfer costs
- Modeling examples (automotive electronics, avionics). Prototype Systems (Aurora, STREAM, TelegraphCQ). Frameworks (Flink, Spark, Storm, Samza, SAMOA)
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Advanced Information Management 2 - Management of Data Streams | Integrated course | 0434 L 471 | Winter semester | [en] | 4 | WS 2026/27 (1) ISIS |
Courses in the course catalog
Courses created from the teaching units of this module.
Winter semester 2026/27 (1)
Advanced Information Management 2 - Management of Data Streams (Integrated course) 1
- Management of Data Streams (Integrierte Veranstaltung) Termingruppe 1 0434 L 471
Workload and credit points
Advanced Information Management 2 - Management of Data Streams (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Lecture | 15 | 2 h | 30 h |
| Labs / Project Work | 15 | 4 h | 60 h |
| Study of Materials | 15 | 2 h | 30 h |
| Seminar Presentations + Reporting | 15 | 4 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
AIM-2 (Advanced Information Management 2 - Management of Data Streams) consists of 4 teaching elements: lectures, in parallel integrated phases of student presentations (individual work) and labs work (group projects plus home work), plus intensive study of literature.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
BSc in Computer Science / Computer Engineering (or similar); good knowledge in 'Databases & Information Systems', 'Software Engineering', and Mathematics
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| Project Work/Homework (small teams = 3 max) | 20 | practical | 30 hours |
| Seminar Talk (individual) | 30 | oral | 20-30 minutes |
| Written Project Report | 35 | written | 20 pages |
| Written Seminar Report (individual) | 15 | written | 8-10 pages |
Exam description
The exam of this module consists of 4 portfolio elements:
3 'deliverable assessements' ("Ergebnisprüfungen"): seminar talk, seminar report, and project report
plus one 'learning process review' ("Lernprozess-Evaluierung"): project (lab & home) work evaluation
3 'deliverable assessements' ("Ergebnisprüfungen"): seminar talk, seminar report, and project report
plus one 'learning process review' ("Lernprozess-Evaluierung"): project (lab & home) work evaluation
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Winter semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
Before semester start, you must announce your interest to the "DIMA Anmeldetool" ('DIMA pre-semester registration tool')!
Within 6 weeks after commencement of the class (but before the first result is to be delivered), you must offiicially register in QISPOS (TUB examination protocol system')
Within 6 weeks after commencement of the class (but before the first result is to be delivered), you must offiicially register in QISPOS (TUB examination protocol system')
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
unavailable
Recommended literature
- Data Streams: Models and Algorithms. Ed. by Charu C. Aggarwal, Springer, 2007 als Basisliteratur, daneben zu jedem Themenkomplex klassische und aktuelle Forschungspapiere.
- J. Leskovec, A.Rajaraman, J.D.Ullman. Mining of Massive Data Sets. Cambridge University Press. 2014, ISBN: 9781107077232
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2020 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
| WS 2020/21 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| SS 2021 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering | |
| WS 2021/22 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
Miscellaneous
Not specified