ECE 534 - Elements of Information Theory

Description:  Credit 4. Entropy and mutual information, fundamentals of coding theory, data compression, complexity of sources, channel mutual information and capacity, rate distortion theory, information theory applications.

Prerequisite:  ECE 341; or consent of the instructor

Textbooks:  Thomas M. Cover and Joy A. Thomas, "Information Theory", John Wiley and Sons, New York, 1991.


1. Entropy and mutual information

2. Fundamental of coding theory

3. Data compression

4. Complexity of sources

5. Channel mutual information and capacity

6. Rate distortion theory

7. Applications