Foundations of Statistical Inference, Detection and EstimationModule description #41105 / Version 2
- 6 CP
- Portfolio examination
- Graded
- Summer semester
- English
| Module / Version | #41105 / #2 |
|---|---|
| Validity | Since Summer semester 2026 |
| Available language(s) | English, German |
| Credit points | 6 |
| Person responsible for the module | Caire, Giuseppe |
| Grading | Graded |
| Exam format | Portfolio examination |
| Language(s) of instruction | English |
Affiliation
| Faculty | Fakultät IV |
|---|---|
| Institute | Institut für Telekommunikationssysteme |
| Academic chair | 34331600 FG Theoretische Grundlagen der Kommunikationstechnik |
Contact
| Office | HFT 6 |
|---|---|
| Contact person | Hantke, Jana |
| E-mail address | jana.hantke@tu-berlin.de |
| Website | https://www.tu.berlin/commit |
Learning outcomes
Students acquire the fundamental background on Statistical Inference, including hypothesis testing, signal detection, parameter estimation, and optimal MMSE linear filtering (in particular, Wiener and Kalman filters). This is one of the foundations of modern Electrical Engineering in the ``Systems’ areas such as Automatic Controls, Communications, and Signal Processing.
Content
Hypothesis Testing (maximum a-posteriori probability, Neyman-Pearson testing, minimax testing)
Signal Detection: uncoded modulation, coded modulation, ISI channels, Viterbi Algorithm, BCJR algorithm
Parameter estimation: Fisher information and Cramer-Rao Bound, minimum variance unbiased estimation, Maximum-Likelihood estimation, Least-Squares, Bayesian estimation
Bayesian inference, sum-product algorithm, and belief propagation
The Approximated Message Passing (AMP) algorithm
Wiener filters and Kalman filters
Signal Detection: uncoded modulation, coded modulation, ISI channels, Viterbi Algorithm, BCJR algorithm
Parameter estimation: Fisher information and Cramer-Rao Bound, minimum variance unbiased estimation, Maximum-Likelihood estimation, Least-Squares, Bayesian estimation
Bayesian inference, sum-product algorithm, and belief propagation
The Approximated Message Passing (AMP) algorithm
Wiener filters and Kalman filters
Module components
Compulsory area
The following courses are mandatory for this module:
Workload and credit points
Detection and Estimation (Lecture)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Pre/post processing | 15 | 3 h | 45 h |
| Preparation for the written test | 1 | 15 h | 15 h |
| 90 h | |||
Applications of statistical inference (Project)
| Workload description | Multiplier | Hours | Total |
|---|---|---|---|
| Attendance | 15 | 2 h | 30 h |
| Project work and preparation for the project presentation | 1 | 45 h | 45 h |
| Pre/post processing | 15 | 1 h | 15 h |
| 90 h | |||
The workload of the module adds up to 180 hours. The module therefore comprises 6 credit points.
Description of teaching and learning methods
The module consists of conventional frontal teaching in class, developing theoretical and mathematical concepts, exercises developed in class, in order to develop problem-solving skills and reinforce comprehension of the theory, and homework exercises in order to develop independent and autonomous thinking skills in the students. Often, problems in probability and stochastic processes will be connected to aspects of electrical engineering, communications, signal processing and controls.
An important component of the module is a semester project that the students will develop using Matlab or some other computation tool (e.g., Python) and is assigned around week 9 in the semester, and will occupy the last few weeks of the semester.
An important component of the module is a semester project that the students will develop using Matlab or some other computation tool (e.g., Python) and is assigned around week 9 in the semester, and will occupy the last few weeks of the semester.
Requirements for participation and examination
Desirable prerequisites for participation in the courses:
Prerequisite for participation to courses is to have already attended and preferably passed the module ``Foundations of Stochastic Processes (Module 40256)
Mandatory requirements for the module examination registration:
This module has no examination requirements.
Completion of the module
| Grading | Graded |
|---|---|
| Exam format | Portfolio examination |
| Type of portfolio examination | 100 points in total |
| Language | English |
Test elements
| Name | Points/Weight | Category | Duration/Extent |
|---|---|---|---|
| (Deliverable assessment) Project report | 30 | written | 1-10 pages |
| (Deliverable assessment) Project presentation | 20 | oral | 20 minutes |
| (Examination) written Test | 50 | written | 45 minutes |
Exam description
The module is passed by collecting points from a written test and a semester project. The written test is formed by of problems illustrating the theory and similar to the examples seen in class.
The project is assigned after enough theoretical material has been covered and will take about 4-5 weeks to develop. There will be a graded final report and oral presentation.
The final note is a result of the total score, converted into a note using the Notenschlüssel 3 (commonly used in Fakulty IV).
The project is assigned after enough theoretical material has been covered and will take about 4-5 weeks to develop. There will be a graded final report and oral presentation.
The final note is a result of the total score, converted into a note using the Notenschlüssel 3 (commonly used in Fakulty IV).
Duration of the module
The following number of semesters is estimated for taking and completing the module: 1 semester(s).
This module can be started in the following semesters: Summer semester.
Maximum number of participants
This module is not limited to a number of students.
Registration procedures
Course teaching and organization (not module examination enrollment at Examination office/Prüfungsamt) is supported by an ISIS course.
Registration details are provided at the beginning of the module.
Registration details are provided at the beginning of the module.
Recommended reading, lecture notes
Lecture notes
unavailable
Electronic lecture notes
available
Recommended literature
- Kay, S.M., 1993. Fundamentals of statistical signal processing: estimation theory. Prentice-Hall, Inc..
- Poor, H. Vincent. An introduction to signal detection and estimation. Springer Science & Business Media, 1998.
Assigned programs
This module version is used in the following programs:
| Program / program version | Semester(s) | Curriculum component |
|---|---|---|
| Computer Engineering Computer Engineering (M. Sc.) - StuPO 2015 | SS 2026 | Wahlpflicht Studiengebiet B › Medientechnik und Mensch-Maschine-Interaktion / Digital Media und Human-Computer Interaction |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet A › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction | |
| Computer Science (Informatik) Computer Science (Informatik) (M. Sc.) - StuPO 2015 | SS 2026 | Studiengebiete › Medientechnik und Mensch-Maschine-Interaktion / Digital Media und Human-Computer Interaction |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiet › Medientechnik und Mensch-Maschine-Interaktion / Digital Media und Human-Computer Interaction | |
| Electrical Engineering Electrical Engineering (M. Sc.) - StuPO 2015 | SS 2026 | Wahlpflicht Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction |
| WS 2026/27 | Wahlpflichtbereich › Studiengebiete Fak. IV › Medientechnik und Mensch-Maschine-Interaktion / Digital Media and Human-Computer Interaction | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2015 | SS 2026 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Communication Systems |
| WS 2026/27 | Ingenieurwissenschaftliche Studienrichtungen/Engineering Majors › Informations- und Kommunikationssysteme/Information and Communication Systems (IKS) › Informations- und Kommunikationssysteme/Information and Communication Systems (Wahlpflicht/Compulsory-Elective) › Communication Systems | |
| Industrial Engineering and Management Industrial Engineering and Management (M. Sc.) - StuPO 2026 | WS 2026/27 | Engineering Sciences / Specialization › Electrical Engineering › Automation & Control |
| Technomathematics Technomathematics (M. Sc.) - StuPO 2014 | SS 2026 | Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET |
| WS 2026/27 | Studienrichtungen › Elektrotechnik › Elektrotechnik › Gesamtangebot Master ET | |
| Technomathematics Technomathematics (B. Sc.) - StuPO 2014 | SS 2026 | Studienrichtungen › Technisches Gebiet - Elektrotechnik › Technisches Gebiet - Elektrotechnik › Katalog Elektronik und Informationstechnik |
| WS 2026/27 | Studienrichtungen › Technisches Gebiet - Elektrotechnik › Technisches Gebiet - Elektrotechnik › Katalog Elektronik und Informationstechnik |
Miscellaneous
Not specified