Elements of Information Theory

This course is an introduction to Information Theory. It starts with a repetition of probability, and roughly follows a selection of topics from "Elements of Information Theory" by T. Cover and J. Thomas. Look on Dokeos for details.

In short

All relevant course information, slides and materials are on Chamilo.

Timetable

Lectures: Friday 10:00-12:00, Bat/404-407, starting from February 20, 2015

Labwork (TP) : Wednesday 8:00-10:00, B319-321, starting from February 25, 2015

People

Instructors:

Sviatoslav Voloshynovskiy

Teaching Assistent

 Sohrab Ferdowsi

Course outline

  • Basic Probability
  • Entropy and uncertainty
  • Source coding
  • Channel Coding

Video Lectures

There are videos online of theextra explanations given during Lab Sessions (TP's).

Supplementary Materials

Books

  • T. Cover and J. Thomas, "Elements of Information Theory", New York: Wiley, 1991.
  • D. MacKay, Information Theory, Inference, and Learning Algorithms, Cambrdige University Press, 2003. It is available online for free.

Prerequisites

You are highly recommended to refresh your knowledge on probability and statistics prior to this class.