ECE 534 - Elements of Information Theory

Description:  Credit 4. Entropy and mutual information, fundamentals of coding theory, data compression, complexity of sources, channel mutual information and capacity, rate distortion theory, information theory applications.

Prerequisite:  ECE 341; or consent of the instructor

Textbooks:  Thomas M. Cover and Joy A. Thomas, "Information Theory", John Wiley and Sons, New York, 1991.

Topics:  
 

1. Entropy and mutual information

2. Fundamental of coding theory

3. Data compression

4. Complexity of sources

5. Channel mutual information and capacity

6. Rate distortion theory

7. Applications