Introduction to Information Theory and Coding

This lecture provides a short introduction to essential topics in information theory for communication engineers. The topics include 1) measures of information and source, 2) Data compression, 3) Channel Capacity and Error Control Codes, 4) a very short description of rate-distortion theory.


  • In this course, we discuss such various topics in probability theory and introductory random processes as probability, random variables, expectations, characteristic functions, random vectors, random processes, correlation functions, and power spectrum. From time to time, homework problems will be assigned, usually not for mandatory submission.

  • This course is a brief introduction to random processes. Topics include Basic operating principles and circuits of AM, FM, and SSB modulation/demodulation, PLLs, mixers, and ADCs; Noise performance of communication systems; Introduction to digital communication techniques such as BPSK, FSK and QAM keying/detections. Issues related to multiple access techniques are covered. (Prerequisite: EE202)

Show List