Elements of Information Theory

This course is an introduction to Information Theory. It starts with a repetition of probability, and roughly follows a selection of topics from "Elements of Information Theory" by T. Cover and J. Thomas. Look on Dokeos for details.

In short

All relevant course information, slides and materials are on dokeos.

Timetable

Lectures:

Labwork (TP) : Wednesday 8:00-10:00, B314-315, starting from February 22

People

Instructors:

Sviatoslav Voloshynovskiy and Oleksiy Koval

Teaching Assistent

Farzad Farhadzadeh and Fokko Beekhof

Course outline

• Basic Probability
• Entropy and uncertainty
• Source coding
• Channel Coding

Video Lectures

There are videos online of theextra explanations given during Lab Sessions (TP's).

Supplementary Materials

Books

• T. Cover and J. Thomas, "Elements of Information Theory", New York: Wiley, 1991.
• D. MacKay, Information Theory, Inference, and Learning Algorithms, Cambrdige University Press, 2003. It is available online for free.

Prerequisites

You are highly recommended to refresh your knowledge on probability and statistics prior to this class.