Module Catalogues, Xi'an Jiaotong-Liverpool University

Module Code: EEE345
Module Title: Information Theory and Data Communications
Module Level: Level 3
Module Credits: 5.00
Semester: SEM1
Originating Department: Electrical and Electronic Engineering
Pre-requisites: N/A

 Aims To enable students to better understand, develop, design and improve data communication systems, with an awareness of fundamental theories and all the main factors involved, and of existing and emerging technologies in data communications and networking.
 Learning outcomes A Identify and explain the nature of data, and the concept of entropy, relative entropy and mutual information;B Elaborate on Shannon’s Theorems and the significance.C Design source coding for data compression;D Explain how noise arises in communications systems and its connection to channel capacity and mutual information, and apply some of the methods to combat the adverse effect of noise. E Design channel coding for error correction;F Design basic encryption/decryption algorithms to provide secrecy of information.G Explain why standard protocol architecture is needed in data communication and interpret the basic components in a communication network.H Identify different topology and design basic routing algorithms applied in a data communication network.
 Method of teaching and learning This module will be delivered by a combination of formal lectures, tutorials and assignments.
 Syllabus 1. IntroductionData, Information source and representation; Signal classification; Noises and errors; Probability and random processes; Communication systems; Communication Networks; Design considerations and limitations.2. Source and EntropyShannon Information Content; Entropy of a source; Joint entropy and chain rule; Relative entropy; Mutual Information; Jensen’s Inequality and data processing inequality.3. Data Compression and source codingShannon’s first theorem on source coding; Source encoder/decoder; Type of source codes; Prefix code; Kraft Inequality; Shannon codes; Huffman codes; Extended Huffman codes.4. Channel CapacityDiscrete memoryless channel; Mutual information and channel capacity; Symmetric channel and binary symmetric channel; Transition probability matrix; Entropy rate; Bandwidth efficiency; Multi-level signaling; Shannon’s second and third theorem.5. Channel Coding Error control coding; Linear block codes; Hamming distance; Least distance decoding; Perfect codes; Generator matrix; Parity-check matrix; Syndrome decoder; Hamming Codes; Dual codes; Expanded Hamming codes; Systematic and Nonsystematic Hamming codes; Performance of linear block codes; Forward error correction; Cyclic Codes; Polynomial representation; Polynomial modulo arithmetic; Systematic and non-systematic cyclic codes; Generation and decoding of cyclic codes.6. CryptologyCryptosystems; Keys in Cryptology; Symmetric Key Cryptosystem; Simple Cipher System; Shannon’s theorem for Perfect Secrecy; Asymmetric Key Cryptosystem; Private and Public Key Encryption; Rivest-Shamir-Adleman (RSA) public key system; Prime numbers and factorization.7. Transceiver Design in Noisy Channels Q-function (Statistics and Detection Theory Point of View); Normal distribution; Inflection point; Mean and standard deviation; Standard normal distribution; z-score and x-score; Receiver operating characteristic; Confusion matrix; Hit rate, miss rate, false alarm rate and correct rejection rate; Decision criterion; Tail property; Optimum receiver design in baseband; Equaliser; Multi-user techniques (FDMA, TDMA, CDMA, OFDMA); Cellular networks; Wireless computer networks; Emerging technologies.8. Communication Networks: Fundamentals Internet; Protocol; Network edge (hosts, access net, physical media); Network core(packet/circuit switching); Internet structure; Protocol layers; Service models; Performance(loss, delay, throughput); Security. 9. Routing Network layer; Virtual circuit and datagram networks; Router; Internet Protocol; Routing algorithms.10. Wireless and Mobile Networks Wireless links; IEEE 802.11 wireless LANs; Mobility users; Addressing and routing to mobile users; Mobile IP
Delivery Hours
 Lectures Seminars Tutorials Lab/Prcaticals Fieldwork / Placement Other(Private study) Total Hours/Semester 40 12 98 150

## Assessment

 Sequence Method % of Final Mark 1 Final Exam 80.00 2 Assignment 1-Wk5 10.00 3 Assignment 2-Wk12 10.00
 Module Catalogue generated from SITS CUT-OFF: 12/10/2019 12:19:32 AM