EC-702 (B) · Information Theory and Coding/Official Syllabus
Information Theory and Coding (EC-702 (B)) - Official Syllabus
1
Unit 1
Information Theory
- Introduction to uncertainty
- entropy and its properties
- entropy of binary memoryless source and its extension to discrete memory-less source
- Measure of information
- Information content of message
- Average Information content of symbols
- Self information
- Mutual information and its properties
2
Unit 2
Coding theorem
- Source coding theorem
- prefix coding
- Shannone28099s Encoding Algorithm
- Shannon Fano Encoding Algorithm
- Huffman coding
- Extended Huffman coding
- Arithmetic Coding
- Lempel-Ziv Coding
- Run Length Encoding
3
Unit 3
Information Channels
- Communication Channels
- Channel Models
- Channel Matrix
- Joint probability Matrix
- Discrete memory less channels
- Binary symmetric channel and its channel capacity
- channel coding theorem
- and its application to Binary Erasure Channel
- Shannone28099s theorem on channel capacity
- capacity of channel of infinite bandwidth
- Continuous Channels
4
Unit 4
Error Control Coding
- Introduction
- Examples of Error control coding
- methods of Controlling Errors
- Types of Errors
- types of Codes
- Linear Block Codes: matrix description of Linear Block Codes
- Error Detection and Error Correction Capabilities of Linear Block Codes
- Probability of undetected error for linear block code in BSC
- hamming Codes and their applications
- Cyclic Codes:Cyclic codes and its basic properties
- Encoding using an (n-k) Bit Shift register
- Generator & parity check matrix of cyclic codes
- encoding & decoding circuits
- syndrome computation
- error detection and correction
5
Unit 5
Introduction to BCH codes, Convolution Codes
- Introduction to BCH codes
- its encoding & decoding
- error location & correction
- Introduction to convolution codes
- its construction
- Convolution Encoder
- Time domain approach
- Transform domain approach
- Code Tree
- Trellis and State Diagram
- Viterbi algorithm: Introduction of theorem for maximum likelihood decoding
Reference Books
- Digital Communication — Simon Haykin
- Error control Coding: Theory and Application — Shu Lin, Costello
- Digital Communication — Sklar — Pearson Education
- Error Correcting Codes — W. Peterson — MIT Press
- Digital Communication — Proakis — TMH
- Information Theory, Coding and Cryptography — Ranjan Bose — TMH
- Communication Systems — Singh, Sapre — TMH
Go to where you left off?
Quick Add to Notes
Save questions, your own notes and screenshots into notes filed by unit. It takes a free account.
Create free accountHave an account? Log in
Notes Panel