Elements of Information Theory
This course is an introduction to Information Theory. It starts with a repetition of probability, and roughly follows a selection of topics from "Elements of Information Theory" by T. Cover and J. Thomas. Look on Dokeos for details.
All relevant course information, slides and materials are on Chamilo.
Lectures: Friday 10:00-12:00, Bat/404-407, starting from February 20, 2015
Labwork (TP) : Wednesday 8:00-10:00, B319-321, starting from February 25, 2015
- Basic Probability
- Entropy and uncertainty
- Source coding
- Channel Coding
There are videos online of theextra explanations given during Lab Sessions (TP's).
- T. Cover and J. Thomas, "Elements of Information Theory", New York: Wiley, 1991.
- D. MacKay, Information Theory, Inference, and Learning Algorithms, Cambrdige University Press, 2003. It is available online for free.
You are highly recommended to refresh your knowledge on probability and statistics prior to this class.