BDAPRO - Big Data Analytics ProjectModulbeschreibung #40494 / Version 4
- 9 LP
- Portfolioprüfung
- Benotet
- Winter- und Sommersemester
- Englisch
Diese Modulbeschreibung gilt nicht im aktuellen Semester (WiSe 2026/27).
Zur aktuellen Version (v12)
| Modul / Version | #40494 / #4 |
|---|---|
| Gültigkeit | SS 2016 – WS 2016/17 |
| Verfügbare Sprache(n) | Englisch |
| Leistungspunkte | 9 |
| Modulverantwortliche*r | Markl, Volker |
| Benotung | Benotet |
| Prüfungsform | Portfolioprüfung |
| Lehrsprache(n) | Englisch |
Zugehörigkeit
| Fakultät | Fakultät IV |
|---|---|
| Institut | Institut für Softwaretechnik und Theoretische Informatik |
| Fachgebiet | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Kontakt
| Sekretariat | FR 7-1 |
|---|---|
| Ansprechpartner*in | Soto, Juan |
| E-Mail-Adresse | sekr@dima.tu-berlin.de |
| Webseite | https://www.tu.berlin/dima |
Lernergebnisse
In this course you will learn to systematically analyze a current issue in the information management
area and to develop and implement a problem-oriented solution as part of a team. You will learn to
cooperate as team member and to contribute to project organization, quality assurance and documentation. The quality of your solution has to be proven through analysis, systematic experiments and test cases. Examples of IMPRO projects carried out in recent semesters are a tool used to analyse Web 2.0 Forum data, an online multiplayer game for mobile phones, implementation and analysis of new join methods for a cloud computing platform or the development of data mining operations on the massively parallel system Hadoop as part of the Apache open source project Mahout.
After the course, students will be able to understand methods for large scale data analytics and to
solve large scale data analytics problems. They will be capable of designing and implementing large
scale data analytics solutions in a collaborative team.
area and to develop and implement a problem-oriented solution as part of a team. You will learn to
cooperate as team member and to contribute to project organization, quality assurance and documentation. The quality of your solution has to be proven through analysis, systematic experiments and test cases. Examples of IMPRO projects carried out in recent semesters are a tool used to analyse Web 2.0 Forum data, an online multiplayer game for mobile phones, implementation and analysis of new join methods for a cloud computing platform or the development of data mining operations on the massively parallel system Hadoop as part of the Apache open source project Mahout.
After the course, students will be able to understand methods for large scale data analytics and to
solve large scale data analytics problems. They will be capable of designing and implementing large
scale data analytics solutions in a collaborative team.
Lehrinhalte
Both the sciences and industry are currently undergoing a profound transformation: large-scale,
diverse data sets - derived from sensors, the web, or via crowd sourcing - present a huge opportunity
for data-driven decision making. This data poses new challenges in a variety of dimensions: in its
unprecedented volume, in the speed at which it is generated (its velocity) and in the variety of data
sources that need to be integrated. A whole new breed of systems and paradigms is currently
developed to be able to cope with that these challenges.
The field of Big Data Analytics deals with the technological means of gaining insights from huge
amounts of data. Students will conduct projects that deal with applying data mining algorithms to large
datasets. For that, students will learn to use so called Parallel Processing Platforms (e.g. Flink, Spark, Hadoop, HBase), systems that execute parallel computations with terabytes of data on clusters of up to several thousand machines.
At the start of the project, a student will receive a topic as well as some information material. The
team, with the assistance of the lecturer, will decide on a project environment with the suitable tools for
team work, project communication, development and testing. Next, the problem will have to be
analyzed, modelled and decomposed into individual components, from which tasks are derived that
are subsequently assigned to smaller teams or individuals. At weekly project meetings, the project
team presents progress and milestones that have been reached. In consultation with the lecturer, it is
decided which further steps to take. The project is concluded with a final report as
well as a final presentation which includes a demonstration of the prototype.
diverse data sets - derived from sensors, the web, or via crowd sourcing - present a huge opportunity
for data-driven decision making. This data poses new challenges in a variety of dimensions: in its
unprecedented volume, in the speed at which it is generated (its velocity) and in the variety of data
sources that need to be integrated. A whole new breed of systems and paradigms is currently
developed to be able to cope with that these challenges.
The field of Big Data Analytics deals with the technological means of gaining insights from huge
amounts of data. Students will conduct projects that deal with applying data mining algorithms to large
datasets. For that, students will learn to use so called Parallel Processing Platforms (e.g. Flink, Spark, Hadoop, HBase), systems that execute parallel computations with terabytes of data on clusters of up to several thousand machines.
At the start of the project, a student will receive a topic as well as some information material. The
team, with the assistance of the lecturer, will decide on a project environment with the suitable tools for
team work, project communication, development and testing. Next, the problem will have to be
analyzed, modelled and decomposed into individual components, from which tasks are derived that
are subsequently assigned to smaller teams or individuals. At weekly project meetings, the project
team presents progress and milestones that have been reached. In consultation with the lecturer, it is
decided which further steps to take. The project is concluded with a final report as
well as a final presentation which includes a demonstration of the prototype.
Modulbestandteile
Pflichtbereich
Die folgenden Veranstaltungen sind für das Modul obligatorisch:
| Lehrveranstaltungen | Art | Nummer | Turnus | Sprache | SWS | VVZ |
|---|---|---|---|---|---|---|
| BDAPRO - Big Data Analytics Project | Projekt | 0434 L 484 | Winter- und Sommersemester | – | 6 | WiSe 2026/27 (1) ISIS |
Veranstaltungen im Vorlesungsverzeichnis
Veranstaltungen, die aus den Lehrveranstaltungen dieses Moduls angelegt wurden.
WiSe 2026/27 (1)
BDAPRO - Big Data Analytics Project (Projekt) 1
- Big Data Systems Project (BDSPRO) (Projekt) Termingruppe 1 0434 L 484
Arbeitsaufwand und Leistungspunkte
BDAPRO - Big Data Analytics Project (Projekt)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Documentation, Presentations | 1 | 40 h | 40 h |
| Implementation, Tests, Experiments | 1 | 130 h | 130 h |
| Participation in Meetings | 20 | 3 h | 60 h |
| Preparation Phase and Design | 1 | 40 h | 40 h |
| 270 h | |||
Der Aufwand des Moduls summiert sich zu 270 Stunden. Damit umfasst das Modul 9 Leistungspunkte.
Beschreibung der Lehr- und Lernformen
Guided and self-organized project work.
Voraussetzungen für die Teilnahme / Prüfung
Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:
Knowledge from the complete Bachelor program (Informatik or Technische Informatik) is required, as
well as linear algebra and statistics. Depending on the topic, additional prerequisites may be required, e.g. „DBT - Database Technology"
Solid programming skills in at least one of the following programming languages: Java, C++, Scala, Python.
Basic knowledge in functional programming.
Basic knowledge in distributed source control management systems (Git, Mercurial) and software processes like Scrum.
well as linear algebra and statistics. Depending on the topic, additional prerequisites may be required, e.g. „DBT - Database Technology"
Solid programming skills in at least one of the following programming languages: Java, C++, Scala, Python.
Basic knowledge in functional programming.
Basic knowledge in distributed source control management systems (Git, Mercurial) and software processes like Scrum.
Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:
Dieses Modul hat keine Prüfungsvoraussetzungen.
Abschluss des Moduls
| Benotung | Benotet |
|---|---|
| Prüfungsform | Portfolioprüfung |
| Sprache | Englisch |
Prüfungselemente
| Name | Punkte/Gewicht | Kategorie | Dauer/Umfang |
|---|---|---|---|
| (Deliverable assessment) Experiments analysis | 20 | ||
| (Deliverable assessment) Final presentation | 20 | ||
| (Deliverable assessment) Intermediate presentation | 10 | ||
| (Learning process review) Experiment design and execution | 20 | ||
| (Learning process review) Prototype with test cases and documentation | 30 |
Prüfungsbeschreibung (Abschluss des Moduls)
The overall grade for the module consists of the results of the course work ('portfolio exam'). The following are included in the final grade:
1. Prototype with test cases and documentation (30p.)
2. Experiment design and execution (20p.)
3. Intermediate presentation (10p.)
4. Experiments analysis (20p.)
5. Final presentation (20p.)
The final grade according to § 47 (2) AllgStuPO will be calculated with the faculty grading table 2.
(Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlüssel 2 der Fakultät IV ermittelt.)
1. Prototype with test cases and documentation (30p.)
2. Experiment design and execution (20p.)
3. Intermediate presentation (10p.)
4. Experiments analysis (20p.)
5. Final presentation (20p.)
The final grade according to § 47 (2) AllgStuPO will be calculated with the faculty grading table 2.
(Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlüssel 2 der Fakultät IV ermittelt.)
Dauer des Moduls
Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt: 1 Semester.
Dieses Modul kann in folgenden Semestern begonnen werden: Winter- und Sommersemester.
Maximale teilnehmende Personen
Die maximale Teilnehmerzahl beträgt 27.
Anmeldeformalitäten
Students are required to register via the DIMA course registration tool before the start of the first lecture (http://www.dima.tu-berlin.de/). Within the first six weeks after commencement of the lecture, students will have to register for the course at QISPOS (university examination protocol tool) in addition to the registration at the DIMA course registration tool.
Literaturhinweise, Skripte
Skript in Papierform
nicht verfügbar
Skript in elektronischer Form
nicht verfügbar
Empfohlene Literatur
- [1] H. Garcia-Molina, J. Ullman, J. Widom: Database Systems – The Complete Book, Pearson 2009
- [2] A. Rajaraman, J. Ullman: Mining of Massive Datasets, Cambridge 2010
- More, project specific, literature will be announced in the first lecture.
Zugeordnete Studiengänge
Dieses Modul findet in keinem Studiengang Verwendung.
This course addresses master students with a focus on database systems and information
management after the first (master) term in “Informatik – System Engineering”, “Technische Informatik
-- Informationssysteme”, “Wirtschaftsingenieurwesen -- IuK”. (If capacity is available, it will be open
also for other faculties).
Moreover it is a compulsory class for the ERASMUS MUNDUS IT4BI master programme.
management after the first (master) term in “Informatik – System Engineering”, “Technische Informatik
-- Informationssysteme”, “Wirtschaftsingenieurwesen -- IuK”. (If capacity is available, it will be open
also for other faculties).
Moreover it is a compulsory class for the ERASMUS MUNDUS IT4BI master programme.
Sonstiges
Keine Angabe