Advanced Information Management 3 - Scalable Data Analysis and Data MiningModule description #40311 / Version 1
- 6 CP
- Oral exam
- Graded
- Summer semester
- English
This module description is not valid in the current semester (Winter semester 2026/27).
| Module / Version | #40311 / #1 |
|---|---|
| Validity | SS 2014 – SS 2014 |
| Available language(s) | English |
| Credit points | 6 |
| Person responsible for the module | Markl, Volker |
| Grading | Graded |
| Exam format | Oral exam |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Softwaretechnik und Theoretische Informatik |
| Academic chair | 34351500 FG Datenbanksysteme und Informationsmanagement (DIMA) |
Contact
| Office | EN 7 |
|---|---|
| Contact person | Soto, Juan |
| E-mail address | sekr@dima.tu-berlin.de |
| Website | https://www.tu.berlin/dima |
Learning outcomes
Recent advances in technology have led to rapid growth of big data. This led to the need for cost
efficient and scalable analysis algorithms. In this course concepts for scalable analysis of big data
sets will be presented and applied using open source technologies. Participants of this module will
gain an in-depth understanding of concepts and methods as well as practical experience in the area
of scalable data analysis and data mining.
The course is principally designed to impart:
technical skills 50% method skills 30% system skills 10% social skills10%
efficient and scalable analysis algorithms. In this course concepts for scalable analysis of big data
sets will be presented and applied using open source technologies. Participants of this module will
gain an in-depth understanding of concepts and methods as well as practical experience in the area
of scalable data analysis and data mining.
The course is principally designed to impart:
technical skills 50% method skills 30% system skills 10% social skills10%
Content
The focus is of this module is to get familiar with different parallel processing platforms and
paradigms and to understand their feasibility for different kinds of data mining problems. For that
students will learn how to adapt popular data mining and standard machine learning algorithms such
as: Naïve Bayes, K-Means clustering or PageRank to scalable processing paradigms. And
subsequently gain practical experience in how to implement them on parallel processing platforms
such as Apache Hadoop, Stratosphere and Apache Giraph.
paradigms and to understand their feasibility for different kinds of data mining problems. For that
students will learn how to adapt popular data mining and standard machine learning algorithms such
as: Naïve Bayes, K-Means clustering or PageRank to scalable processing paradigms. And
subsequently gain practical experience in how to implement them on parallel processing platforms
such as Apache Hadoop, Stratosphere and Apache Giraph.
Module components
Compulsory area
The following courses are mandatory for this module:
| Courses | Type | Number | Frequency | Language | Hours per week | Course catalog |
|---|---|---|---|---|---|---|
| Advanced Information Management 3 - Scalable Data Analytics and Data Mining | Integrated course | 0434 L 472 | Summer semester | – | 4 | ISIS |
Workload and credit points
Advanced Information Management 3 - Scalable Data Analytics and Data Mining (Integrated course)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Exercises / practice | 15 | 2 h | 30 h |
| Final report & presentation (as preparation for oral exam) | 15 | 2 h | 30 h |
| Plenary sessions | 15 | 4 h | 60 h |
| Preparation / Consolidation (including literature work and seminar presentation) | 15 | 4 h | 60 h |
| 180 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
This „integrated course“(Integrierte Veranstaltung, IV) consists of lectures on key concepts and
exercise sessions with smaller and larger exercises, particularly one complex task, to be fulfilled in
team work. This includes elaborating one of the key topics with own literature work, giving a short
presentation and developing an implementation. Active contribution to all parts of the course is
essential, as there will be a final presentation of the complex exercise by all members of the course.
exercise sessions with smaller and larger exercises, particularly one complex task, to be fulfilled in
team work. This includes elaborating one of the key topics with own literature work, giving a short
presentation and developing an implementation. Active contribution to all parts of the course is
essential, as there will be a final presentation of the complex exercise by all members of the course.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Prerequisites: The material covered in the basic modules MPGI 1-5 in the Bachelor Curriculum in
Computer Sciences/ TU Berlin, MPGI5 (“Datenbanksysteme”) as well as good Java programming
skills are required. A basic understanding of Probability and Statistics as well as Linear Algebra is
helpful.
The AIM-3 / SDADM course will be given in English language, thus fluency in English is required!
Computer Sciences/ TU Berlin, MPGI5 (“Datenbanksysteme”) as well as good Java programming
skills are required. A basic understanding of Probability and Statistics as well as Linear Algebra is
helpful.
The AIM-3 / SDADM course will be given in English language, thus fluency in English is required!
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Oral exam |
| Language | English |
Exam description
The grade will be given with an oral examination. To be admitted for this final exam, a participant must
fulfill all required tasks during the course: seminar work; active participation in home/lab exercises
including final report and presentation.
fulfill all required tasks during the course: seminar work; active participation in home/lab exercises
including final report and presentation.
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
The maximum capacity of participants is 30.
Registration procedures
Students are required to register via the DIMA course registration tool before the start of the first
lecture (http://www.dima.tu-berlin.de/). Within the first six weeks after commencement of the lecture,
students will have to register for the course at QISPOS (university examination protocol tool) and ISIS
(course organization tool) in addition to the registration at the DIMA course registration tool.
lecture (http://www.dima.tu-berlin.de/). Within the first six weeks after commencement of the lecture,
students will have to register for the course at QISPOS (university examination protocol tool) and ISIS
(course organization tool) in addition to the registration at the DIMA course registration tool.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available – http://www.dima.tu-berlin.de
Recommended literature
- Anand Rajaraman, Jeffrey David Ullman : Mining of Massive Datasets (Free Online: http://infolab.stanford.edu/~ullman/mmds/book.pdf)
- Ian H. Witten, Eibe Frank: Data Mining: Practical Machine Learning Tools and Techniques.
- Tom White: Hadoop: The Definitive Guide von Tom White
Assigned programs
This module is not used in any program.
open for the remaining diploma students in the mentioned areas.
Miscellaneous
This module is offered each summer term.
For each topic during this course additional research papers and reports will be used.
For each topic during this course additional research papers and reports will be used.