Zum Inhalt springen
Technische Universität Berlin English
Vorlesungsverzeichnis und Modultransfersystem

Informationstheorie und Codierung (ET)Modulbeschreibung #40101 / Version 5

← Zur Modulseite English version
Diese Modulbeschreibung gilt nicht im aktuellen Semester (WiSe 2026/27).
Modul / Version#40101 / #5
GültigkeitSS 2016 – WS 2016/17
Verfügbare Sprache(n)Englisch
Leistungspunkte12
Modulverantwortliche*rCaire, Giuseppe
BenotungBenotet
PrüfungsformPortfolioprüfung
Lehrsprache(n)Englisch

Zugehörigkeit

FakultätFakultät IV
InstitutInstitut für Telekommunikationssysteme
Fachgebiet34331600 FG Theoretische Grundlagen der Kommunikationstechnik

Kontakt

SekretariatHFT 6
Ansprechpartner*inCaire, Giuseppe
E-Mail-Adressecaire@tu-berlin.de
Webseitehttp://www.commit.tu-berlin.de/menue/lehre/

Lernergebnisse

Communication networks are perhaps the most pervasive and ubiquitous infrastructure of our
times. Billions of people around the world access information, make business, share experiences and stay
in touch with each other through the Internet, and in particular using wireless access.


The fundamental science and engineering knowledge that made this astonishing development
possible finds its origin in the seminal paper by Claude E. Shannon, "A Mathematical Theory of Communication", published in 1948. This fundamental work represents the birth of the modern
information age. Astonishingly, at a time where the telephone networks was
analog and based on electromechanical circuit switching and radio reduced to analog broadcasting,
Shannon deployed the fundamental concepts of information measures (Entropy, Mutual Information)
and their operational significance as the fundamental limits of data compression (how many
bits of information are necessary to compress an information source without any loss?), channel
coding (how many bits of information per unit time can be sent through a communication channel
such that the message is recovered by the receiver with arbitrarily low error probability?) and
source coding (how many bits of information are necessary to represent an information source such
that its can be reconstructed within a desired fidelity level?).
Since Shannon's work, the field of modern digital communications, channel coding, data networks,
source coding and wireless/cellular communications has developed enormously. Very large
and successful companies, such as Qualcomm, Ericsson, Nokia, Alcatel Lucent, Siemens, Huawei,
Broadcom, Intel, Samsung, have been setting the technology trends, and standards such as TCP/IP,
IEEE 802.11, IEEE 802.16, GSM, IS-95, and the more recent 3GPP family of standards (e.g.,
LTE/LTE-A) enable ubiquitous connectivity and the merging of a variety of communication networks
onto a common interconnected platform. Perhaps the most striking fact is that Shannon's
theoretical conclusions, that information is essentially "discrete" (i.e., digital) and that any source
can be reduced to a common currency (bits), such bits can be exchanged reliably through a network
which is somehow source-agnostic, and reconstructed at the end users within a near-optimal fidelity
level, has become a fact of everyday's life, that we all enjoy and experience. Today, we use the
Internet, most of the times supported by a wireless access network, to consume a wealth of different
sources (audio, speech, video, data, images, text) that in the not-so-distant past required separate
and very different networks (e.g., FM radio, land-line telephone networks, cellular telephone
networks, telegraph/telex, mail/currier delivery, cable TV, UHF/VHF TV, Satellite TV).

The module ``Information Theory and Coding'' provides a comprehensive background on
foundations and specific theoretical knowledge on information theory and channel coding, thus providing the
theoretical background that stays at the basis of modern digital communication networks. Furthermore,
through a rich set of possible elective courses, the students will have the opportunity of
acquiring additional knowledge in specific areas of interest, some of which are advanced theoretical, and others are more applied and practical, according to each student specific orientation and interest.

Lehrinhalte

The module ``Information Theory and Coding'' consists of 4 courses of 3 Pts each, for a total of
12 Pts (ECTS). Two of these courses are required:

1) Information Theory;
2) Modern Channel Coding;

Other two can be chosen within a list of elective courses.

Information Theory presents the fundamentals of Information Theory. In particular,
information measures and information sources, and the fundamental limits of data compression,
channel coding and (lossy) source coding. Relations to channel coding theory, communication
theory and signal processing (notably, audio, image and video coding) are evidenced.

Modern Channel Coding presents an overview of the channel coding techniques currently
used in wireless network standards and data storage systems. Classical coding theory (algebraic
coding) is presented at a glance, with some examples of classical codes (Hamming codes and their
duals) and particular emphasis on Reed-Solomon codes. Then, a graph-theoretic framework is
adopted to present convolutional codes and sparse graph codes (Turbo Codes, LDPC codes) and
their decoding algorithms (Viterbi Decoding, Belief Propagation Decoding). Finally, some special
topics are presented as on-going research, such as regenerative storage codes and their relationship
with network coding, spatially coupled codes and their iterative decoding threshold analysis.

In the list of elective courses, there is the possibility of choosing the two lab-oriented courses in a
sequence: Wireless Digital Communications Lab I and Wireless Digital Communications Lab II, which
provide the students with a hands-on practical training based on Matlab, on the
algorithms studied in theory on the two required courses. Other elective include:
Compressed Sensing (also known as sparse signal reconstruction, provides the basics of a
new area in signal processing focused on the estimation of inherently redundant signals when only a small
number of linear projections are available, which is gaining more and more importance in areas such as
image coding, features identification, machine learning schemes, channel estimation in wireless
communications, and computation in big-data sets), Network Information Theory (this presents the
extension of classical information theory to network problems, i.e., problems involving more than one
source and one destination, which is at the basis of modern and efficient system design in wireless
networks),
Modern Channel Coding (a comprehensive overview of ``graph-based'' modern channel codes and their
iterative decoding algorithms, such as Turbo Codes, LDPC codes, Spatially coupled LDPC codes),
Wireless Communication Systems (a deep overview of present and future
wireless communication standards, their design rationale and their main working principles), Physical-
Layer Security (information-theoretic methods to achieve secure communication over a wireless channel),
MIMO Systems and Adaptive Transmission (schemes and techniques for multiple-antenna systems, which
have become very popular in recent years and have been massively adopted in wireless communication
standards such as IEEE 802.11n, 802.11ac, and 3GPP LTE-Advanced).

Modulbestandteile

Pflichtbereich

Die folgenden Veranstaltungen sind für das Modul obligatorisch:

LehrveranstaltungenArtNummerTurnusSpracheSWSVVZ
Information TheoryVorlesung0432 L 654 Wintersemester–2 ISIS
Modern Channel CodingVorlesung34331600 L 003 Sommersemester–2 ISIS

Wahlpflichtbereich

Aus den folgenden Veranstaltungen muss eine Auswahl abgeschlossen werden:

LehrveranstaltungenArtNummerTurnusSpracheSWSVVZ
Compressed SensingVorlesung0432 L 664 Wintersemester–2 ISIS
MIMO Systems and Adaptive TransmissionVorlesung34331600 L 006 Sommersemester–2 ISIS
Network Information TheoryVorlesung34331600 L 001 Sommersemester–2 ISIS
Physical-Layer SecurityVorlesung34331600 L 002 Wintersemester–2 ISIS
Sparse Signal Processing, Applications and AlgorithmsSeminar34331600 L 009 Sommersemester–2 ISIS
Wireless Communication SystemsVorlesung0432 L 615 Sommersemester–2 ISIS
Wireless Digital Communications Lab IPraktikum0432 L 658 Wintersemester–2 ISIS
Wireless Digital Communications Lab IIPraktikum34331600 L 005 Sommersemester–2 ISIS

Veranstaltungen im Vorlesungsverzeichnis

Veranstaltungen, die aus den Lehrveranstaltungen dieses Moduls angelegt wurden.

WiSe 2026/27 (2)

Wireless Communication Systems (Vorlesung) 1

Alle Gruppen dieser Lehrveranstaltung im Verzeichnis

Wireless Digital Communications Lab I (Praktikum) 1

Alle Gruppen dieser Lehrveranstaltung im Verzeichnis

Arbeitsaufwand und Leistungspunkte

Information Theory (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Modern Channel Coding (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Compressed Sensing (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

MIMO Systems and Adaptive Transmission (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Network Information Theory (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Physical-Layer Security (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Sparse Signal Processing, Applications and Algorithms (Seminar)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Wireless Communication Systems (Vorlesung)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Wireless Digital Communications Lab I (Praktikum)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Wireless Digital Communications Lab II (Praktikum)

AufwandbeschreibungMultiplikatorStundenGesamt
Präsenzzeit152 h30 h
Vor-/Nachbereitung154 h60 h
90 h

Der Aufwand des Moduls summiert sich zu 900 Stunden. Damit umfasst das Modul 12 Leistungspunkte.

Beschreibung der Lehr- und Lernformen

Courses are taught through lectures, problem-solving sessions (exercises in class),
and integrated laboratory practical work, computer projects (mainly in Matlab), and homework/independent
work at home. Attendance is required in all events held in the classroom and in the labs, both practical
work and lectures.

Voraussetzungen für die Teilnahme / Prüfung

Wünschenswerte Voraussetzungen für die Teilnahme an den Lehrveranstaltungen:

Suitable desired pre-requisites for participation to courses are a basic
knowledge of information technology, as described in particular in the courses "Signale und Systeme"
and "Nachrichtenübertragung" of the field of study "Elektronik und Informationstechnik"
of the BSc degree program. This module is open to students enrolled in the
Elektrotechnik MSc degree program. For participation in the laboratory work,
basic knowledge of programming with MatLab is desirable, but it will be in any case provided for those
students who do not have such background.

Verpflichtende Voraussetzungen für die Modulprüfungsanmeldung:

Dieses Modul hat keine Prüfungsvoraussetzungen.

Abschluss des Moduls

BenotungBenotet
PrüfungsformPortfolioprüfung
SpracheEnglisch

Prüfungselemente

NamePunkte/GewichtKategorieDauer/Umfang
(Deliverable assessment) Oral performance assessments, including possible project presentations, for all elective courses40
(Examination) Written performance assessments for the required courses60

Prüfungsbeschreibung (Abschluss des Moduls)

A total of 100 points portfolio can be achieved:

• two written performance assessments (30 portfolio points each) for the required courses:
Modern Channel Coding and Information Theory.

• Oral performance assessments, including possible project presentations, for all other elective courses (20
portfolio points each).

Die Gesamtnote gemäß § 47 (2) AllgStuPO wird nach dem Notenschlussel 3 der Fakultät IV ermittelt

Dauer des Moduls

Für Belegung und Abschluss des Moduls ist folgende Semesteranzahl veranschlagt: 2 Semester.

Dieses Modul kann in folgenden Semestern begonnen werden: Winter- und Sommersemester.

Maximale teilnehmende Personen

Dieses Modul ist nicht auf eine Anzahl Studierender begrenzt.

Anmeldeformalitäten

The number of participants is limited only in the Laboratory courses, because of lab space.
Registration for the lab courses and integrated course is done online.
Information can be found at:

www.commit.tu-berlin.de,

and it will be given anyway on the first date of the lecture in the required courses.

Literaturhinweise, Skripte

Skript in Papierform

nicht verfügbar

Skript in elektronischer Form

verfügbar

Empfohlene Literatur

Keine empfohlene Literatur angegeben

Zugeordnete Studiengänge

Dieses Modul findet in keinem Studiengang Verwendung.

Sonstiges

Course material for the various courses will be provided on-line.
Textbooks are indicated as ``non-mandatory desirable reading'', but the courses are self-contained, i.e.,
purchase of textbooks is not mandatory.