Module Catalogues, Xi'an Jiaotong-Liverpool University   
Module Code: EEE345
Module Title: Information Theory and Data Communications
Module Level: Level 3
Module Credits: 5.00
Academic Year: 2019/20
Semester: SEM1
Originating Department: Electrical and Electronic Engineering
Pre-requisites: N/A
To enable students to better understand, develop, design and improve data communication systems, with an awareness of fundamental theories and all the main factors involved, and of existing and emerging technologies in data communications and networking.
Learning outcomes 
A Identify and explain the nature of data, and the concept of entropy, relative entropy and mutual information;

B Elaborate on Shannon’s Theorems and the significance.

C Design source coding for data compression;

D Explain how noise arises in communications systems and its connection to channel capacity and mutual information, and apply some of the methods to combat the adverse effect of noise.

E Design channel coding for error correction;

F Design basic encryption/decryption algorithms to provide secrecy of information.

G Explain why standard protocol architecture is needed in data communication and interpret the basic components in a communication network.

H Identify different topology and design basic routing algorithms applied in a data communication network.
Method of teaching and learning 
This module will be delivered by a combination of formal lectures, tutorials and assignments.
1. Introduction

Data, Information source and representation; Signal classification; Noises and errors; Probability and random processes; Communication systems; Communication Networks; Design considerations and limitations.

2. Source and Entropy

Shannon Information Content; Entropy of a source; Joint entropy and chain rule; Relative entropy; Mutual Information; Jensen’s Inequality and data processing inequality.

3. Data Compression and source coding

Shannon’s first theorem on source coding; Source encoder/decoder; Type of source codes; Prefix code; Kraft Inequality; Shannon codes; Huffman codes; Extended Huffman codes.

4. Channel Capacity

Discrete memoryless channel; Mutual information and channel capacity; Symmetric channel and binary symmetric channel; Transition probability matrix; Entropy rate; Bandwidth efficiency; Multi-level signaling; Shannon’s second and third theorem.

5. Channel Coding

Error control coding; Linear block codes; Hamming distance; Least distance decoding; Perfect codes; Generator matrix; Parity-check matrix; Syndrome decoder; Hamming Codes; Dual codes; Expanded Hamming codes; Systematic and Nonsystematic Hamming codes; Performance of linear block codes; Forward error correction; Cyclic Codes; Polynomial representation; Polynomial modulo arithmetic; Systematic and non-systematic cyclic codes; Generation and decoding of cyclic codes.

6. Cryptology

Cryptosystems; Keys in Cryptology; Symmetric Key Cryptosystem; Simple Cipher System; Shannon’s theorem for Perfect Secrecy; Asymmetric Key Cryptosystem; Private and Public Key Encryption; Rivest-Shamir-Adleman (RSA) public key system; Prime numbers and factorization.

7. Transceiver Design in Noisy Channels

Q-function (Statistics and Detection Theory Point of View); Normal distribution; Inflection point; Mean and standard deviation; Standard normal distribution; z-score and x-score; Receiver operating characteristic; Confusion matrix; Hit rate, miss rate, false alarm rate and correct rejection rate; Decision criterion; Tail property; Optimum receiver design in baseband; Equaliser; Multi-user techniques (FDMA, TDMA, CDMA, OFDMA); Cellular networks; Wireless computer networks; Emerging technologies.

8. Communication Networks: Fundamentals

Internet; Protocol; Network edge (hosts, access net, physical media); Network core(packet/circuit switching); Internet structure; Protocol layers; Service models; Performance(loss, delay, throughput); Security.

9. Routing

Network layer; Virtual circuit and datagram networks; Router; Internet Protocol; Routing algorithms.

10. Wireless and Mobile Networks

Wireless links; IEEE 802.11 wireless LANs; Mobility users; Addressing and routing to mobile users; Mobile IP

Delivery Hours  
Lectures Seminars Tutorials Lab/Prcaticals Fieldwork / Placement Other(Private study) Total
Hours/Semester 40    12      98  150 


Sequence Method % of Final Mark
1 Final Exam 80.00
2 Assignment 1-Wk5 10.00
3 Assignment 2-Wk12 10.00

Module Catalogue generated from SITS CUT-OFF: 8/20/2019 6:27:03 PM