Aims and Fit of Module
To introduce the concept of entropy and Shannon’s Theorems in information theory;
To introduce the concept of channel capacity under the influence of noise from information theory point of view;
To provide the fundamental knowledge of source coding, channel coding and cryptography.
Learning outcomes
A. Explain the concept of entropy, relative entropy and mutual information;
B. Elaborate on Shannon’s Theorems and the significance;
C. Design source coding for data compression;
D. Identify the importance of channel capacity and its connection to mutual information;
E. Design channel coding for error correction;
F. Design basic encryption/decryption algorithms to provide secrecy of information.
Method of teaching and learning
This module will be delivered through a combination of formal lectures and tutorials.