Module Catalogues

Information Theory and coding

Module Title Information Theory and coding
Module Level Level 3
Module Credits 2.50
Academic Year 2018/19
Semester SEM1

Aims and Fit of Module

To introduce the concept of entropy and Shannon’s Theorems in information theory;
To introduce the concept of channel capacity under the influence of noise from information theory point of view;
To provide the fundamental knowledge of source coding, channel coding and cryptography.

Learning outcomes

A. Explain the concept of entropy, relative entropy and mutual information;
B. Elaborate on Shannon’s Theorems and the significance;
C. Design source coding for data compression;
D. Identify the importance of channel capacity and its connection to mutual information;
E. Design channel coding for error correction;
F. Design basic encryption/decryption algorithms to provide secrecy of information.

Method of teaching and learning

This module will be delivered through a combination of formal lectures and tutorials.