BDSPRO Big Data Systems ProjectModulbeschreibung #40494 / Version 8
- 9 LP
- Portfolioprüfung
- Benotet
- Winter- und Sommersemester
- Englisch
Diese Modulbeschreibung gilt nicht im aktuellen Semester (WiSe 2026/27).
Zur aktuellen Version (v12)
| Modul / Version | #40494 / #8 |
|---|---|
| Gültigkeit | SoSe 2023 – SoSe 2023 |
| Verfügbare Sprache(n) | Englisch |
| Leistungspunkte | 9 |
| Modulverantwortliche*r | Markl, Volker |
| Benotung | Benotet |
| Prüfungsform | Portfolioprüfung |
| Lehrsprache(n) | Englisch |
Zugehörigkeit
| Fakultät | Fakultät IV |
|---|---|
| Institut | Institut für Softwaretechnik und Theoretische Informatik |
| Fachgebiet | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Kontakt
| Sekretariat | FR 7-1 |
|---|---|
| Ansprechpartner*in | Soto, Juan |
| E-Mail-Adresse | sekr@dima.tu-berlin.de |
| Webseite | https://www.tu.berlin/dima |
Lernergebnisse
In this course students will learn how to systematically analyze a current issue in the Big Data management area as well as develop and implement a problem-oriented solution as part of a team. Students will learn how to cooperate as team member, to contribute to project organization, quality assurance and documentation, and to evaluate the quality of your solution through analysis, systematic experiments and test cases. After the course, students will be able to understand the architecture of large scale data systems and to solve problems behind the end-to-end design, implementation, and testing of large scale data management systems. They will be capable of designing and implementing solutions to improve the performance and feature-completeness of large-scale data systems in a collaborative team.
Lehrinhalte
Both the sciences and industry are currently undergoing a profound transformation: large-scale, diverse data sets - derived from Internet-of-Things sensors, the web, or via crowd sourcing - present a huge opportunity for data-driven decision making. This data poses new challenges in a variety of dimensions: in its unprecedented volume, in the speed at which it is generated (its velocity) and in the variety of data sources that need to be integrated. The field of Big Data Systems deals with the technological means of processing high-volume of data to gain insights from data. A whole new breed of systems and paradigms has been developed to to cope with that these challenges. However, current systems still fall short in addressing many user needs. Therefore, further system research is necessary to achieve robust query performance in any scenario. As a result, students will conduct projects that deal with topics related to current data management trends, such as Modern Hardware, Stateful Data Stream Processing, Sensor Data Management, Compiler Technology, Query Optimization, Machine Learning for Databases, and many others. This scope of the project will be adjusted to the final group size to reflect the overall workload of the course (i.e., 270h of work per student) For that, students will learn the algorithms, system design, and actual implementation of the so called Distributed Processing Platforms (e.g., Flink, NebulaStream, Spark). These are systems that execute parallel computations on terabytes of data on clusters as well as distributed Internet-of-Things topologies of up to several thousand machines. At the start of the project, a student will receive a topic as well as some information material. The team, with the assistance of the lecturer, will decide on a project environment with the suitable tools for team work, project communication, development and testing. Next, the problem will have to be analyzed, modelled and decomposed into individual components, from which tasks are derived that are subsequently assigned to smaller teams or individuals. At weekly project meetings, the project team presents progress and milestones that have been reached. In consultation with the lecturer, it is decided which further steps to take. The project is concluded with a final presentation which includes a demonstration of the prototype.
Modulbestandteile
Pflichtbereich
Die folgenden Veranstaltungen sind für das Modul obligatorisch:
| Lehrveranstaltungen | Art | Nummer | Turnus | Sprache | SWS | VVZ |
|---|---|---|---|---|---|---|
| BDAPRO - Big Data Analytics Project | Projekt | 0434 L 484 | Winter- und Sommersemester | – | 6 | WiSe 2026/27 (1) ISIS |
Veranstaltungen im Vorlesungsverzeichnis
Veranstaltungen, die aus den Lehrveranstaltungen dieses Moduls angelegt wurden.
WiSe 2026/27 (1)
BDAPRO - Big Data Analytics Project (Projekt) 1
- Big Data Systems Project (BDSPRO) (Projekt) Termingruppe 1 0434 L 484
Arbeitsaufwand und Leistungspunkte
BDAPRO - Big Data Analytics Project (Projekt)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Documentation, Presentation | 1 | 40 h | 40 h |
| Implementation, Tests, Experiments | 1 | 130 h | 130 h |
| Participation in Meetings | 20 | 3 h | 60 h |
| Preparation Phase and Design | 1 | 40 h | 40 h |
| 270 h | |||
Der Aufwand des Moduls summiert sich zu 270 Stunden. Damit umfasst das Modul 9 Leistungspunkte.
Beschreibung der Lehr- und Lernformen
Guided and self-organized project work.
Voraussetzungen für die Teilnahme / Prüfung
Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:
1. General computer science knowledge (e.g., algorithms, data structures, systems architecture, distributed systems) obtained via the completion of a Bachelor's (e.g., B.Sc. in Computer Science) is required, as well as linear algebra and statistics.
2. Depending on the topic, additional prerequisites may be required (e.g., Database Technology, Data Management on Modern Hardware, Machine Learning, Compilers).
3. Solid programming skills in at least one of the following programming languages: Java, C++, Scala, or Python.
4. Basic knowledge in functional programming.
5. Basic knowledge in distributed source control management systems (i.e., Git) and software development processes such as Agile.
6. Students must have completed DBT or an equivalent course on database internals prior to enrolling in BDSPRO. If not, alternatively, students must be concurrently enrolled in DBT and BDSPRO in the same semester.
2. Depending on the topic, additional prerequisites may be required (e.g., Database Technology, Data Management on Modern Hardware, Machine Learning, Compilers).
3. Solid programming skills in at least one of the following programming languages: Java, C++, Scala, or Python.
4. Basic knowledge in functional programming.
5. Basic knowledge in distributed source control management systems (i.e., Git) and software development processes such as Agile.
6. Students must have completed DBT or an equivalent course on database internals prior to enrolling in BDSPRO. If not, alternatively, students must be concurrently enrolled in DBT and BDSPRO in the same semester.
Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:
Dieses Modul hat keine Prüfungsvoraussetzungen.
Abschluss des Moduls
| Benotung | Benotet |
|---|---|
| Prüfungsform | Portfolioprüfung |
| Art der Portfolioprüfung | 100 Punkte insgesamt |
| Sprache | Englisch |
Prüfungselemente
| Name | Punkte/Gewicht | Kategorie | Dauer/Umfang |
|---|---|---|---|
| (Deliverable Assessment) Experiments Analysis | 20 | praktisch | about 30h |
| (Deliverable Assessment) Final Presentation | 20 | mündlich | about 20 minutes |
| (Deliverable Assessment) Intermediate Presentation | 10 | mündlich | about 10-15 minutes |
| (Learning Process Review) Experiment Design and Execution | 20 | praktisch | about 30h |
| (Learning Process Review) Prototype with Test Cases and Documentation | 30 | praktisch | about 60h |
Prüfungsbeschreibung (Abschluss des Moduls)
The overall grade for the module consists of the results of the course work ('portfolio exam'). The following are included in the final grade:
1. Prototype with test cases and documentation (30p.)
2. Experiment design and execution (20p.)
3. Intermediate presentation (10p.)
4. Experiments analysis (20p.)
5. Final presentation (20p.)
In the final grade, students are graded individually, i.e., final grades between students in a group can vary depending on the amount of work carried out by each person.
The final grade according to § 68 (2) AllgStuPO will be calculated with the faculty grading table 2.
(Die Gesamtnote gemäß § 68 (2) AllgStuPO wird nach dem Notenschlüssel 2 der Fakultät IV ermittelt.)
1. Prototype with test cases and documentation (30p.)
2. Experiment design and execution (20p.)
3. Intermediate presentation (10p.)
4. Experiments analysis (20p.)
5. Final presentation (20p.)
In the final grade, students are graded individually, i.e., final grades between students in a group can vary depending on the amount of work carried out by each person.
The final grade according to § 68 (2) AllgStuPO will be calculated with the faculty grading table 2.
(Die Gesamtnote gemäß § 68 (2) AllgStuPO wird nach dem Notenschlüssel 2 der Fakultät IV ermittelt.)
Dauer des Moduls
Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt: 1 Semester.
Dieses Modul kann in folgenden Semestern begonnen werden: Winter- und Sommersemester.
Maximale teilnehmende Personen
Die maximale Teilnehmerzahl beträgt 12.
Anmeldeformalitäten
Students are required to register for the course in the official TUB examination system within six weeks after commencement of the first lecture or when the first graded assignment is due, whichever happens to be first.
Literaturhinweise, Skripte
Skript in Papierform
nicht verfügbar
Skript in elektronischer Form
nicht verfügbar
Empfohlene Literatur
- Project specific literature will be announced in the first lecture.
Zugeordnete Studiengänge
Diese Modulversion wird in folgenden Studiengängen verwendet:
| Studiengang / StuPO | Semester | Studiengangsbereich |
|---|---|---|
| Wirtschaftsingenieurwesen StuPO 2015 | SoSe 2023 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Data and Software Engineering |
This course addresses master students with a focus on database systems and information
management after the first (master) term in “Informatik - System Engineering”, “Technische Informatik
-- Informationssysteme”, “Wirtschaftsingenieurwesen -- IuK”. (If capacity is available, it will be open
also for other faculties).
management after the first (master) term in “Informatik - System Engineering”, “Technische Informatik
-- Informationssysteme”, “Wirtschaftsingenieurwesen -- IuK”. (If capacity is available, it will be open
also for other faculties).
Sonstiges
Keine Angabe