Machine IntelligenceModulbeschreibung #40786 / Version 3
- 12 LP
- Mündliche Prüfung
- Benotet
- Winter- und Sommersemester
- Englisch
Diese Modulbeschreibung gilt nicht im aktuellen Semester (WiSe 2026/27).
Zur aktuellen Version (v5)
| Modul / Version | #40786 / #3 |
|---|---|
| Gültigkeit | SS 2017 – SoSe 2021 |
| Verfügbare Sprache(n) | Englisch |
| Leistungspunkte | 12 |
| Modulverantwortliche*r | Obermayer, Klaus |
| Benotung | Benotet |
| Prüfungsform | Mündliche Prüfung |
| Lehrsprache(n) | Englisch |
Zugehörigkeit
| Fakultät | Fakultät IV |
|---|---|
| Institut | Institut für Softwaretechnik und Theoretische Informatik |
| Fachgebiet | 34351300 FG Neuronale Informationsverarbeitung |
Kontakt
| Sekretariat | MAR 5-6 |
|---|---|
| Ansprechpartner*in | Groiß, Camilla |
| E-Mail-Adresse | sekr@ni.tu-berlin.de |
| Webseite | https://www.bccn-berlin.de/courses-and-modules.html |
Lernergebnisse
In this module, participants will gain knowledge about:
- basic concepts, their theoretical foundation and the most common algorithms used in machine learning
and artificial intelligence
- strengths and limitations of the different paradigms
They will be enabled to:
- apply methods and algorithms to real world problems
- be aware of performance criteria
- critically evaluate results obtained with those methods
- modify algorithms to new tasks at hand
- develop new algorithms according to the paradigms presented in this course.
- basic concepts, their theoretical foundation and the most common algorithms used in machine learning
and artificial intelligence
- strengths and limitations of the different paradigms
They will be enabled to:
- apply methods and algorithms to real world problems
- be aware of performance criteria
- critically evaluate results obtained with those methods
- modify algorithms to new tasks at hand
- develop new algorithms according to the paradigms presented in this course.
Lehrinhalte
Part 1: Artificial neural networks. Connectionist neurons, the multilayer perceptron, radial basis function
networks, learning by empirical risk minimization, gradient-based optimization, overfitting and underfitting,
regularization techniques, deep networks, applications to classification and regression problems.
Part 2: Learning theory and support vector machines. Elements of statistical learning theory, learning by
structural risk minimization, the C Support Vector Machine, kernels and non-linear decision boundaries,
SMO optimization, the P-SVM.
Part 3: Probabilistic methods. Reasoning under uncertainty and Bayesian inference; graphical models,
graphs vs. distributions, and belief propagation; generative models; Bayesian inference and neural
networks; non-parametric density estimation; parametric density estimation and maximum likelihood
methods.
Part 4: Reinforcement learning (MDP, value iteration, policy iteration, Q-learning).
Part 5: Projections methods. Principal Component Analysis and Kernel-PCA; independent component
analysis and blind source separation techniques (Infomax, Fast-ICA, ESD).
Part 6: Stochastic optimization. Simulated annealing, mean-field techniques.
Part 7: Clustering and embedding. K-means clustering, pairwise clustering methods, self-organizing maps
for central and pairwise data.
networks, learning by empirical risk minimization, gradient-based optimization, overfitting and underfitting,
regularization techniques, deep networks, applications to classification and regression problems.
Part 2: Learning theory and support vector machines. Elements of statistical learning theory, learning by
structural risk minimization, the C Support Vector Machine, kernels and non-linear decision boundaries,
SMO optimization, the P-SVM.
Part 3: Probabilistic methods. Reasoning under uncertainty and Bayesian inference; graphical models,
graphs vs. distributions, and belief propagation; generative models; Bayesian inference and neural
networks; non-parametric density estimation; parametric density estimation and maximum likelihood
methods.
Part 4: Reinforcement learning (MDP, value iteration, policy iteration, Q-learning).
Part 5: Projections methods. Principal Component Analysis and Kernel-PCA; independent component
analysis and blind source separation techniques (Infomax, Fast-ICA, ESD).
Part 6: Stochastic optimization. Simulated annealing, mean-field techniques.
Part 7: Clustering and embedding. K-means clustering, pairwise clustering methods, self-organizing maps
for central and pairwise data.
Modulbestandteile
Pflichtbereich
Die folgenden Veranstaltungen sind für das Modul obligatorisch:
| Lehrveranstaltungen | Art | Nummer | Turnus | Sprache | SWS | VVZ |
|---|---|---|---|---|---|---|
| Machine Intelligence I | Vorlesung | 0434 L 866 | Wintersemester | – | 2 | WiSe 2026/27 (1) ISIS |
| Machine Intelligence II | Vorlesung | 0434 L 867 | Sommersemester | – | 2 | ISIS |
| Machine Intelligence I | Übung | 0434 L 866 | Wintersemester | – | 2 | WiSe 2026/27 (1) ISIS |
| Machine Intelligence II | Übung | 0434 L 867 | Sommersemester | – | 2 | ISIS |
Veranstaltungen im Vorlesungsverzeichnis
Veranstaltungen, die aus den Lehrveranstaltungen dieses Moduls angelegt wurden.
WiSe 2026/27 (2)
Machine Intelligence I (Vorlesung) 1
- Machine Intelligence I (Vorlesung) Termingruppe 1 0434 L 866
Machine Intelligence I (Übung) 1
- Machine Intelligence I (Übung) Termingruppe 1 0434 L 866
Arbeitsaufwand und Leistungspunkte
Machine Intelligence I (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 2 h | 30 h |
| 60 h | |||
Machine Intelligence II (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 2 h | 30 h |
| 60 h | |||
Machine Intelligence I (Übung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 6 h | 90 h |
| 120 h | |||
Machine Intelligence II (Übung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 6 h | 90 h |
| 120 h | |||
Der Aufwand des Moduls summiert sich zu 360 Stunden. Damit umfasst das Modul 12 Leistungspunkte.
Beschreibung der Lehr- und Lernformen
The lecture part consists of teaching in front of the class. Participants are expected to rehearse topics after
class, using their class notes as well as recommended book chapters, in preparation for the exercises and
tutorials. Homework assignments are given on a regular basis, and must be usually solved within one or
two weeks. These assignments cover analytical & mathematical exercises as well as numerical
simulations & programming exercises. Working in small groups of two to three students is encouraged.
Homework assignments and their solutions are discussed during the tutorial. In addition, selected topics
presented during the lecture are rehearsed by the tutor as needed. The first tutorials cover a brief
mathematics primer, and recommendations are provided for students for the module “individual studies”, if
deficits in their mathematical knowledge become obvious.
class, using their class notes as well as recommended book chapters, in preparation for the exercises and
tutorials. Homework assignments are given on a regular basis, and must be usually solved within one or
two weeks. These assignments cover analytical & mathematical exercises as well as numerical
simulations & programming exercises. Working in small groups of two to three students is encouraged.
Homework assignments and their solutions are discussed during the tutorial. In addition, selected topics
presented during the lecture are rehearsed by the tutor as needed. The first tutorials cover a brief
mathematics primer, and recommendations are provided for students for the module “individual studies”, if
deficits in their mathematical knowledge become obvious.
Voraussetzungen für die Teilnahme / Prüfung
Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:
Wünschenswerte Voraussetzungen für die Teilnahme zu den Lehrveranstaltungen:
Mathematical knowledge: Analysis, linear algebra, probability calculus and statistics, on a level
comparable
to mathematics courses for engineers (worth 24 credit points).
Basic programming skills.
Good command of the English language.
Mathematical knowledge: Analysis, linear algebra, probability calculus and statistics, on a level
comparable
to mathematics courses for engineers (worth 24 credit points).
Basic programming skills.
Good command of the English language.
Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:
Die Prüfungsvoraussetzungen konnten nicht abgerufen werden.
Abschluss des Moduls
| Benotung | Benotet |
|---|---|
| Prüfungsform | Mündliche Prüfung |
| Sprache | Englisch |
| Dauer/Umfang | 30 Min. |
Dauer des Moduls
Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt: 2 Semester.
Dieses Modul kann in folgenden Semestern begonnen werden: Winter- und Sommersemester.
Maximale teilnehmende Personen
Dieses Modul ist nicht auf eine Anzahl Studierender begrenzt.
Anmeldeformalitäten
Enrollment to the module is handled in the first class of each module component (cf. 3). Students must be
present in person. The module components Machine Intelligence I (lecture with exercises) and Machine
Intelligence II (lecture with exercises) can be taken in any order, i.e. students may also start the module in
the summer term. To be allowed to do the oral exam, students must achieve (seperately) at least 60% of
the points awarded for homework in each of the two lectures.
Students of the Master program in Computational Neuroscience have to register for the final oral exam at
least three working days prior to the examination date. Registration has to be done with the examination
office (Prüfungsamt) of TU Berlin. For students from other programs, other regulations may apply. Please
consult the examination regulations (Prüfungsordnung) of your program.
sekr@ni.tu-berlin.de
present in person. The module components Machine Intelligence I (lecture with exercises) and Machine
Intelligence II (lecture with exercises) can be taken in any order, i.e. students may also start the module in
the summer term. To be allowed to do the oral exam, students must achieve (seperately) at least 60% of
the points awarded for homework in each of the two lectures.
Students of the Master program in Computational Neuroscience have to register for the final oral exam at
least three working days prior to the examination date. Registration has to be done with the examination
office (Prüfungsamt) of TU Berlin. For students from other programs, other regulations may apply. Please
consult the examination regulations (Prüfungsordnung) of your program.
sekr@ni.tu-berlin.de
Literaturhinweise, Skripte
Skript in Papierform
nicht verfügbar
Skript in elektronischer Form
verfügbar
Empfohlene Literatur
- 01. Bishop, Pattern Recognition and Machine Learning, Springer-Verlag, 2006. (recommended)
- 02. Duda, Hart, Stock, Pattern Classification, Wiley, 2000. (recommended)
- 03. Haykin, Neural Networks, Prentice Hall, 1998. (recommended)
- 04. Kohonen, Self-Organizing Maps, Springer-Verlag, 1997. (recommended)
- 05. Schölkopf, Smola, Learning with Kernels, MIT Press, 2002. (recommended)
- 06. Russel, Norvig, Artificial Intelligence, Prentice Hall, 2003, Chapters 13 and 14. (recommended)
- 07. Cichocki, Amari, Adaptive Blind Signal and Image Processing, Wiley, 2002. (additional)
- 08. Cowell, Dawid, Lauritzen, Spiegelhalter, Probabilistic Networks and Expert Systems, Springer Verlag, 1999. (additional)
- 09. Hyvärinen, Karhunen, Oja, Independent Component Analysis, Wiley, 2001. (additional)
- 10. Jordan (Editor), Learning in Graphical Models, MIT Press, 1999. (additional)
- 11. Kay, Fundamentals of Statistical Signal Processing - Vol. I: Estimation Theory, Prentice Hall, 1993. (additional)
- 12. Ripley, Pattern Recognition and Neural Networks, Cambridge University Press, 1996. (additional)
- 13. Vapnik, Statistical Learning Theory, Wiley, 1998. (additional)
- One or two specific book chapters are assigned / recomended to every topic of the lecture. This list of recommendations is explained during the first class of every module component and is available via TU Berlin’s ISIS platform
Zugeordnete Studiengänge
Dieses Modul findet in keinem Studiengang Verwendung.
Sonstiges
Das Modul ist exclusiv Studenten des Studiengangs „Computational Neuroscience (MSc) vorbehalten. Studenten anderer Studiengänge sollten statt dessen die beiden Module „Machine Intelligence 1“ und „Machine Intelligence 2“ belegen.
The modul is restricted to students of „computational neuroscience (Msc)“. All other students should instead register for the courses „machine intelligence 1“ and „machine intelligence 2“.
The modul is restricted to students of „computational neuroscience (Msc)“. All other students should instead register for the courses „machine intelligence 1“ and „machine intelligence 2“.