Informationstheorie und Codierung (ET)Modulbeschreibung #40101 / Version 5
- 12 LP
- Portfolioprüfung
- Benotet
- Winter- und Sommersemester
- Englisch
Diese Modulbeschreibung gilt nicht im aktuellen Semester (WiSe 2026/27).
| Modul / Version | #40101 / #5 |
|---|---|
| Gültigkeit | SS 2016 – WS 2016/17 |
| Verfügbare Sprache(n) | Englisch |
| Leistungspunkte | 12 |
| Modulverantwortliche*r | Caire, Giuseppe |
| Benotung | Benotet |
| Prüfungsform | Portfolioprüfung |
| Lehrsprache(n) | Englisch |
Zugehörigkeit
| Fakultät | Fakultät IV |
|---|---|
| Institut | Institut für Telekommunikationssysteme |
| Fachgebiet | 34331600 FG Theoretische Grundlagen der Kommunikationstechnik |
Kontakt
| Sekretariat | HFT 6 |
|---|---|
| Ansprechpartner*in | Caire, Giuseppe |
| E-Mail-Adresse | caire@tu-berlin.de |
| Webseite | http://www.commit.tu-berlin.de/menue/lehre/ |
Lernergebnisse
Communication networks are perhaps the most pervasive and ubiquitous infrastructure of our
times. Billions of people around the world access information, make business, share experiences and stay
in touch with each other through the Internet, and in particular using wireless access.
The fundamental science and engineering knowledge that made this astonishing development
possible finds its origin in the seminal paper by Claude E. Shannon, "A Mathematical Theory of Communication", published in 1948. This fundamental work represents the birth of the modern
information age. Astonishingly, at a time where the telephone networks was
analog and based on electromechanical circuit switching and radio reduced to analog broadcasting,
Shannon deployed the fundamental concepts of information measures (Entropy, Mutual Information)
and their operational significance as the fundamental limits of data compression (how many
bits of information are necessary to compress an information source without any loss?), channel
coding (how many bits of information per unit time can be sent through a communication channel
such that the message is recovered by the receiver with arbitrarily low error probability?) and
source coding (how many bits of information are necessary to represent an information source such
that its can be reconstructed within a desired fidelity level?).
Since Shannon's work, the field of modern digital communications, channel coding, data networks,
source coding and wireless/cellular communications has developed enormously. Very large
and successful companies, such as Qualcomm, Ericsson, Nokia, Alcatel Lucent, Siemens, Huawei,
Broadcom, Intel, Samsung, have been setting the technology trends, and standards such as TCP/IP,
IEEE 802.11, IEEE 802.16, GSM, IS-95, and the more recent 3GPP family of standards (e.g.,
LTE/LTE-A) enable ubiquitous connectivity and the merging of a variety of communication networks
onto a common interconnected platform. Perhaps the most striking fact is that Shannon's
theoretical conclusions, that information is essentially "discrete" (i.e., digital) and that any source
can be reduced to a common currency (bits), such bits can be exchanged reliably through a network
which is somehow source-agnostic, and reconstructed at the end users within a near-optimal fidelity
level, has become a fact of everyday's life, that we all enjoy and experience. Today, we use the
Internet, most of the times supported by a wireless access network, to consume a wealth of different
sources (audio, speech, video, data, images, text) that in the not-so-distant past required separate
and very different networks (e.g., FM radio, land-line telephone networks, cellular telephone
networks, telegraph/telex, mail/currier delivery, cable TV, UHF/VHF TV, Satellite TV).
The module ``Information Theory and Coding'' provides a comprehensive background on
foundations and specific theoretical knowledge on information theory and channel coding, thus providing the
theoretical background that stays at the basis of modern digital communication networks. Furthermore,
through a rich set of possible elective courses, the students will have the opportunity of
acquiring additional knowledge in specific areas of interest, some of which are advanced theoretical, and others are more applied and practical, according to each student specific orientation and interest.
times. Billions of people around the world access information, make business, share experiences and stay
in touch with each other through the Internet, and in particular using wireless access.
The fundamental science and engineering knowledge that made this astonishing development
possible finds its origin in the seminal paper by Claude E. Shannon, "A Mathematical Theory of Communication", published in 1948. This fundamental work represents the birth of the modern
information age. Astonishingly, at a time where the telephone networks was
analog and based on electromechanical circuit switching and radio reduced to analog broadcasting,
Shannon deployed the fundamental concepts of information measures (Entropy, Mutual Information)
and their operational significance as the fundamental limits of data compression (how many
bits of information are necessary to compress an information source without any loss?), channel
coding (how many bits of information per unit time can be sent through a communication channel
such that the message is recovered by the receiver with arbitrarily low error probability?) and
source coding (how many bits of information are necessary to represent an information source such
that its can be reconstructed within a desired fidelity level?).
Since Shannon's work, the field of modern digital communications, channel coding, data networks,
source coding and wireless/cellular communications has developed enormously. Very large
and successful companies, such as Qualcomm, Ericsson, Nokia, Alcatel Lucent, Siemens, Huawei,
Broadcom, Intel, Samsung, have been setting the technology trends, and standards such as TCP/IP,
IEEE 802.11, IEEE 802.16, GSM, IS-95, and the more recent 3GPP family of standards (e.g.,
LTE/LTE-A) enable ubiquitous connectivity and the merging of a variety of communication networks
onto a common interconnected platform. Perhaps the most striking fact is that Shannon's
theoretical conclusions, that information is essentially "discrete" (i.e., digital) and that any source
can be reduced to a common currency (bits), such bits can be exchanged reliably through a network
which is somehow source-agnostic, and reconstructed at the end users within a near-optimal fidelity
level, has become a fact of everyday's life, that we all enjoy and experience. Today, we use the
Internet, most of the times supported by a wireless access network, to consume a wealth of different
sources (audio, speech, video, data, images, text) that in the not-so-distant past required separate
and very different networks (e.g., FM radio, land-line telephone networks, cellular telephone
networks, telegraph/telex, mail/currier delivery, cable TV, UHF/VHF TV, Satellite TV).
The module ``Information Theory and Coding'' provides a comprehensive background on
foundations and specific theoretical knowledge on information theory and channel coding, thus providing the
theoretical background that stays at the basis of modern digital communication networks. Furthermore,
through a rich set of possible elective courses, the students will have the opportunity of
acquiring additional knowledge in specific areas of interest, some of which are advanced theoretical, and others are more applied and practical, according to each student specific orientation and interest.
Lehrinhalte
The module ``Information Theory and Coding'' consists of 4 courses of 3 Pts each, for a total of
12 Pts (ECTS). Two of these courses are required:
1) Information Theory;
2) Modern Channel Coding;
Other two can be chosen within a list of elective courses.
Information Theory presents the fundamentals of Information Theory. In particular,
information measures and information sources, and the fundamental limits of data compression,
channel coding and (lossy) source coding. Relations to channel coding theory, communication
theory and signal processing (notably, audio, image and video coding) are evidenced.
Modern Channel Coding presents an overview of the channel coding techniques currently
used in wireless network standards and data storage systems. Classical coding theory (algebraic
coding) is presented at a glance, with some examples of classical codes (Hamming codes and their
duals) and particular emphasis on Reed-Solomon codes. Then, a graph-theoretic framework is
adopted to present convolutional codes and sparse graph codes (Turbo Codes, LDPC codes) and
their decoding algorithms (Viterbi Decoding, Belief Propagation Decoding). Finally, some special
topics are presented as on-going research, such as regenerative storage codes and their relationship
with network coding, spatially coupled codes and their iterative decoding threshold analysis.
In the list of elective courses, there is the possibility of choosing the two lab-oriented courses in a
sequence: Wireless Digital Communications Lab I and Wireless Digital Communications Lab II, which
provide the students with a hands-on practical training based on Matlab, on the
algorithms studied in theory on the two required courses. Other elective include:
Compressed Sensing (also known as sparse signal reconstruction, provides the basics of a
new area in signal processing focused on the estimation of inherently redundant signals when only a small
number of linear projections are available, which is gaining more and more importance in areas such as
image coding, features identification, machine learning schemes, channel estimation in wireless
communications, and computation in big-data sets), Network Information Theory (this presents the
extension of classical information theory to network problems, i.e., problems involving more than one
source and one destination, which is at the basis of modern and efficient system design in wireless
networks),
Modern Channel Coding (a comprehensive overview of ``graph-based'' modern channel codes and their
iterative decoding algorithms, such as Turbo Codes, LDPC codes, Spatially coupled LDPC codes),
Wireless Communication Systems (a deep overview of present and future
wireless communication standards, their design rationale and their main working principles), Physical-
Layer Security (information-theoretic methods to achieve secure communication over a wireless channel),
MIMO Systems and Adaptive Transmission (schemes and techniques for multiple-antenna systems, which
have become very popular in recent years and have been massively adopted in wireless communication
standards such as IEEE 802.11n, 802.11ac, and 3GPP LTE-Advanced).
12 Pts (ECTS). Two of these courses are required:
1) Information Theory;
2) Modern Channel Coding;
Other two can be chosen within a list of elective courses.
Information Theory presents the fundamentals of Information Theory. In particular,
information measures and information sources, and the fundamental limits of data compression,
channel coding and (lossy) source coding. Relations to channel coding theory, communication
theory and signal processing (notably, audio, image and video coding) are evidenced.
Modern Channel Coding presents an overview of the channel coding techniques currently
used in wireless network standards and data storage systems. Classical coding theory (algebraic
coding) is presented at a glance, with some examples of classical codes (Hamming codes and their
duals) and particular emphasis on Reed-Solomon codes. Then, a graph-theoretic framework is
adopted to present convolutional codes and sparse graph codes (Turbo Codes, LDPC codes) and
their decoding algorithms (Viterbi Decoding, Belief Propagation Decoding). Finally, some special
topics are presented as on-going research, such as regenerative storage codes and their relationship
with network coding, spatially coupled codes and their iterative decoding threshold analysis.
In the list of elective courses, there is the possibility of choosing the two lab-oriented courses in a
sequence: Wireless Digital Communications Lab I and Wireless Digital Communications Lab II, which
provide the students with a hands-on practical training based on Matlab, on the
algorithms studied in theory on the two required courses. Other elective include:
Compressed Sensing (also known as sparse signal reconstruction, provides the basics of a
new area in signal processing focused on the estimation of inherently redundant signals when only a small
number of linear projections are available, which is gaining more and more importance in areas such as
image coding, features identification, machine learning schemes, channel estimation in wireless
communications, and computation in big-data sets), Network Information Theory (this presents the
extension of classical information theory to network problems, i.e., problems involving more than one
source and one destination, which is at the basis of modern and efficient system design in wireless
networks),
Modern Channel Coding (a comprehensive overview of ``graph-based'' modern channel codes and their
iterative decoding algorithms, such as Turbo Codes, LDPC codes, Spatially coupled LDPC codes),
Wireless Communication Systems (a deep overview of present and future
wireless communication standards, their design rationale and their main working principles), Physical-
Layer Security (information-theoretic methods to achieve secure communication over a wireless channel),
MIMO Systems and Adaptive Transmission (schemes and techniques for multiple-antenna systems, which
have become very popular in recent years and have been massively adopted in wireless communication
standards such as IEEE 802.11n, 802.11ac, and 3GPP LTE-Advanced).
Modulbestandteile
Pflichtbereich
Die folgenden Veranstaltungen sind für das Modul obligatorisch:
| Lehrveranstaltungen | Art | Nummer | Turnus | Sprache | SWS | VVZ |
|---|---|---|---|---|---|---|
| Information Theory | Vorlesung | 0432 L 654 | Wintersemester | – | 2 | ISIS |
| Modern Channel Coding | Vorlesung | 34331600 L 003 | Sommersemester | – | 2 | ISIS |
Wahlpflichtbereich
Aus den folgenden Veranstaltungen muss eine Auswahl abgeschlossen werden:
| Lehrveranstaltungen | Art | Nummer | Turnus | Sprache | SWS | VVZ |
|---|---|---|---|---|---|---|
| Compressed Sensing | Vorlesung | 0432 L 664 | Wintersemester | – | 2 | ISIS |
| MIMO Systems and Adaptive Transmission | Vorlesung | 34331600 L 006 | Sommersemester | – | 2 | ISIS |
| Network Information Theory | Vorlesung | 34331600 L 001 | Sommersemester | – | 2 | ISIS |
| Physical-Layer Security | Vorlesung | 34331600 L 002 | Wintersemester | – | 2 | ISIS |
| Sparse Signal Processing, Applications and Algorithms | Seminar | 34331600 L 009 | Sommersemester | – | 2 | ISIS |
| Wireless Communication Systems | Vorlesung | 0432 L 615 | Sommersemester | – | 2 | WiSe 2026/27 (1) ISIS |
| Wireless Digital Communications Lab I | Praktikum | 0432 L 658 | Wintersemester | – | 2 | WiSe 2026/27 (1) ISIS |
| Wireless Digital Communications Lab II | Praktikum | 34331600 L 005 | Sommersemester | – | 2 | ISIS |
Veranstaltungen im Vorlesungsverzeichnis
Veranstaltungen, die aus den Lehrveranstaltungen dieses Moduls angelegt wurden.
WiSe 2026/27 (2)
Wireless Communication Systems (Vorlesung) 1
- Wireless Communication Systems (Vorlesung) Termingruppe 1 0432 L 615
Wireless Digital Communications Lab I (Praktikum) 1
- Wireless Digital Communications Lab I (Praktikum) 1. Termingruppe 0432 L 658
Arbeitsaufwand und Leistungspunkte
Information Theory (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Modern Channel Coding (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Compressed Sensing (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
MIMO Systems and Adaptive Transmission (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Network Information Theory (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Physical-Layer Security (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Sparse Signal Processing, Applications and Algorithms (Seminar)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Wireless Communication Systems (Vorlesung)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Wireless Digital Communications Lab I (Praktikum)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Wireless Digital Communications Lab II (Praktikum)
| Aufwandbeschreibung | Multiplikator | Stunden | Gesamt |
|---|---|---|---|
| Präsenzzeit | 15 | 2 h | 30 h |
| Vor-/Nachbereitung | 15 | 4 h | 60 h |
| 90 h | |||
Der Aufwand des Moduls summiert sich zu 900 Stunden. Damit umfasst das Modul 12 Leistungspunkte.
Beschreibung der Lehr- und Lernformen
Courses are taught through lectures, problem-solving sessions (exercises in class),
and integrated laboratory practical work, computer projects (mainly in Matlab), and homework/independent
work at home. Attendance is required in all events held in the classroom and in the labs, both practical
work and lectures.
and integrated laboratory practical work, computer projects (mainly in Matlab), and homework/independent
work at home. Attendance is required in all events held in the classroom and in the labs, both practical
work and lectures.
Voraussetzungen für die Teilnahme / Prüfung
Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:
Suitable desired pre-requisites for participation to courses are a basic
knowledge of information technology, as described in particular in the courses "Signale und Systeme"
and "Nachrichtenübertragung" of the field of study "Elektronik und Informationstechnik"
of the BSc degree program. This module is open to students enrolled in the
Elektrotechnik MSc degree program. For participation in the laboratory work,
basic knowledge of programming with MatLab is desirable, but it will be in any case provided for those
students who do not have such background.
knowledge of information technology, as described in particular in the courses "Signale und Systeme"
and "Nachrichtenübertragung" of the field of study "Elektronik und Informationstechnik"
of the BSc degree program. This module is open to students enrolled in the
Elektrotechnik MSc degree program. For participation in the laboratory work,
basic knowledge of programming with MatLab is desirable, but it will be in any case provided for those
students who do not have such background.
Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:
Dieses Modul hat keine Prüfungsvoraussetzungen.
Abschluss des Moduls
| Benotung | Benotet |
|---|---|
| Prüfungsform | Portfolioprüfung |
| Sprache | Englisch |
Prüfungselemente
| Name | Punkte/Gewicht | Kategorie | Dauer/Umfang |
|---|---|---|---|
| (Deliverable assessment) Oral performance assessments, including possible project presentations, for all elective courses | 40 | ||
| (Examination) Written performance assessments for the required courses | 60 |
Prüfungsbeschreibung (Abschluss des Moduls)
A total of 100 points portfolio can be achieved:
• two written performance assessments (30 portfolio points each) for the required courses:
Modern Channel Coding and Information Theory.
• Oral performance assessments, including possible project presentations, for all other elective courses (20
portfolio points each).
Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlussel 3 der Fakultät IV ermittelt
• two written performance assessments (30 portfolio points each) for the required courses:
Modern Channel Coding and Information Theory.
• Oral performance assessments, including possible project presentations, for all other elective courses (20
portfolio points each).
Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlussel 3 der Fakultät IV ermittelt
Dauer des Moduls
Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt: 2 Semester.
Dieses Modul kann in folgenden Semestern begonnen werden: Winter- und Sommersemester.
Maximale teilnehmende Personen
Dieses Modul ist nicht auf eine Anzahl Studierender begrenzt.
Anmeldeformalitäten
The number of participants is limited only in the Laboratory courses, because of lab space.
Registration for the lab courses and integrated course is done online.
Information can be found at:
www.commit.tu-berlin.de,
and it will be given anyway on the first date of the lecture in the required courses.
Registration for the lab courses and integrated course is done online.
Information can be found at:
www.commit.tu-berlin.de,
and it will be given anyway on the first date of the lecture in the required courses.
Literaturhinweise, Skripte
Skript in Papierform
nicht verfügbar
Skript in elektronischer Form
verfügbar
Empfohlene Literatur
Keine empfohlene Literatur angegeben
Zugeordnete Studiengänge
Dieses Modul findet in keinem Studiengang Verwendung.
Sonstiges
Course material for the various courses will be provided on-line.
Textbooks are indicated as ``non-mandatory desirable reading'', but the courses are self-contained, i.e.,
purchase of textbooks is not mandatory.
Textbooks are indicated as ``non-mandatory desirable reading'', but the courses are self-contained, i.e.,
purchase of textbooks is not mandatory.