Applied Digital Information theory

Overview & Synopsis

This note serves as a comprehensive guide to fundamental concepts in
information theory and coding. This pdf provides discrete probability theory,
information theory, and coding principles. Beginning with Shannons measure of
information, then delves into the efficient coding of information, the
methodology of typical sequences is introduced, emphasizing the distinction
between lossy and lossless source encoding. The text also discusses coding for
noisy digital channels, block coding principles and tree and trellis coding
principles.