Elements of Information Theory

This course is an introduction to Information Theory. It starts with a repetition of probability, and roughly follows a selection of topics from "Elements of Information Theory" by T. Cover and J. Thomas. Look on Dokeos for details.

In short

All relevant course information, slides and materials are on Chamilo.


Lectures: Friday 10:00-12:00, Bat/404-407, starting from February 20, 2015

Labwork (TP) : Wednesday 8:00-10:00, B319-321, starting from February 25, 2015



Sviatoslav Voloshynovskiy

Teaching Assistent

 Sohrab Ferdowsi

Course outline

  • Basic Probability
  • Entropy and uncertainty
  • Source coding
  • Channel Coding

Video Lectures

There are videos online of theextra explanations given during Lab Sessions (TP's).

Supplementary Materials


  • T. Cover and J. Thomas, "Elements of Information Theory", New York: Wiley, 1991.
  • D. MacKay, Information Theory, Inference, and Learning Algorithms, Cambrdige University Press, 2003. It is available online for free.


You are highly recommended to refresh your knowledge on probability and statistics prior to this class.