Advanced Information Management 3 - Scalable Data Analysis and Data MiningModule description #40311 / Version 2
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- German
This module description is not valid in the current semester (Winter semester 2026/27).
| Module / Version | #40311 / #2 |
|---|---|
| Validity | WS 2014/15 – SS 2015 |
| Available language(s) | German |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | German |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | EN 7 |
|---|---|
| Contact person | Soto, Juan |
| E-mail address | sekr@dima.tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
Recent advances in technology have led to rapid growth of big data. This led to the need for cost
efficient and scalable analysis algorithms. In this course concepts for scalable analysis of big data
sets will be presented and applied using open source technologies. Participants of this module will
gain an in-depth understanding of concepts and methods as well as practical experience in the area
of scalable data analysis and data mining.
The course is principally designed to impart:
technical skills 50% method skills 30% system skills 10% social skills10%
efficient and scalable analysis algorithms. In this course concepts for scalable analysis of big data
sets will be presented and applied using open source technologies. Participants of this module will
gain an in-depth understanding of concepts and methods as well as practical experience in the area
of scalable data analysis and data mining.
The course is principally designed to impart:
technical skills 50% method skills 30% system skills 10% social skills10%
Content
The focus is of this module is to get familiar with different parallel processing platforms and
paradigms and to understand their feasibility for different kinds of data mining problems. For that
students will learn how to adapt popular data mining and standard machine learning algorithms such
as: Naïve Bayes, K-Means clustering or PageRank to scalable processing paradigms. And
subsequently gain practical experience in how to implement them on parallel processing platforms
such as Apache Hadoop, Stratosphere and Apache Giraph.
paradigms and to understand their feasibility for different kinds of data mining problems. For that
students will learn how to adapt popular data mining and standard machine learning algorithms such
as: Naïve Bayes, K-Means clustering or PageRank to scalable processing paradigms. And
subsequently gain practical experience in how to implement them on parallel processing platforms
such as Apache Hadoop, Stratosphere and Apache Giraph.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Advanced Information Management 3 - Scalable Data Analytics and Data Mining | Integrated course | 0434 L 472 | Summer semester | – | 4 | ISIS |
Workload and credit points
Advanced Information Management 3 - Scalable Data Analytics and Data Mining (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Exercises / practice | 15 | 2 h | 30 h |
| Plenary sessions | 15 | 4 h | 60 h |
| Preparation & Consolidation (incl. literature studies) | 15 | 2 h | 30 h |
| Project Work | 15 | 4 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
This „integrated course“(Integrierte Veranstaltung, IV) consists of lectures on key concepts and
exercise sessions with smaller and larger exercises, particularly one complex task, to be fulfilled in
team work. This includes elaborating one of the key topics with own literature work, giving a short
presentation and developing an implementation. Active contribution to all parts of the course is
essential, as there will be a final presentation of the complex exercise by all members of the course.
exercise sessions with smaller and larger exercises, particularly one complex task, to be fulfilled in
team work. This includes elaborating one of the key topics with own literature work, giving a short
presentation and developing an implementation. Active contribution to all parts of the course is
essential, as there will be a final presentation of the complex exercise by all members of the course.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Prerequisites: The material covered in the basic modules MPGI 1-5 in the Bachelor Curriculum in
Computer Sciences/ TU Berlin, MPGI5 (“Datenbanksysteme”) as well as good Java programming
skills are required. A basic understanding of Probability and Statistics as well as Linear Algebra is
helpful.
The AIM-3 / SDADM course will be given in English language, thus fluency in English is required!
Computer Sciences/ TU Berlin, MPGI5 (“Datenbanksysteme”) as well as good Java programming
skills are required. A basic understanding of Probability and Statistics as well as Linear Algebra is
helpful.
The AIM-3 / SDADM course will be given in English language, thus fluency in English is required!
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Language | German |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| oral feedback session | 30 | ||
| protocolled project work | 50 | ||
| written homework | 20 |
Exam description
Prüfungsform ist die Portfolioprüfung. Insgesamt können 100 Portfoliopunkte erreicht werden:
- Schriftliche Ausarbeitung (Hausaufgabe) (20 Portfoliopunkte)
- Protokollierte Praktische Leistung (Projektaufgabe) (50 Portfoliopunkte)
- Mündliche Rücksprache (30 Portfoliopunkte)
Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlüssel 2 der Fakultät IV ermittelt.
--
The exam will be done as a 'portfolio exam', consisting of three portfolio parts,
and totaling for 100 portfolio points:
- written homework (20 portfolio points)
- protocolled practical project work (50 portfolio points)
- oral feedback session (30 portfolio points)
The final grade will be computed according to the grading table 2 of faculty IV,
according to German law, § 47 (2) AllgStuPO TU Berlin.
- Schriftliche Ausarbeitung (Hausaufgabe) (20 Portfoliopunkte)
- Protokollierte Praktische Leistung (Projektaufgabe) (50 Portfoliopunkte)
- Mündliche Rücksprache (30 Portfoliopunkte)
Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlüssel 2 der Fakultät IV ermittelt.
--
The exam will be done as a 'portfolio exam', consisting of three portfolio parts,
and totaling for 100 portfolio points:
- written homework (20 portfolio points)
- protocolled practical project work (50 portfolio points)
- oral feedback session (30 portfolio points)
The final grade will be computed according to the grading table 2 of faculty IV,
according to German law, § 47 (2) AllgStuPO TU Berlin.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
Students are required to register via the DIMA course registration tool before the start of the first
lecture (http://www.dima.tu-berlin.de/). Within the first six weeks after commencement of the lecture,
students will have to register for the course at QISPOS (university examination protocol tool) and ISIS
(course organization tool) in addition to the registration at the DIMA course registration tool.
lecture (http://www.dima.tu-berlin.de/). Within the first six weeks after commencement of the lecture,
students will have to register for the course at QISPOS (university examination protocol tool) and ISIS
(course organization tool) in addition to the registration at the DIMA course registration tool.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – http://www.dima.tu-berlin.de
Recommended literature
- Anand Rajaraman, Jeffrey David Ullman : Mining of Massive Datasets (Free Online: http://infolab.stanford.edu/~ullman/mmds/book.pdf)
- Ian H. Witten, Eibe Frank: Data Mining: Practical Machine Learning Tools and Techniques.
- Tom White: Hadoop: The Definitive Guide von Tom White
Assigned programs
This module is not used in any program.
open for the remaining diploma students in the mentioned areas.
Miscellaneous
Since 2014, this module is offered each summer and winter term.
For each topic during this course additional research papers and reports will be used.
For each topic during this course additional research papers and reports will be used.