Information Theory

Based on a linear model of communication (transmission perspective).

Information (measured in bits) is the amount of uncertainty a message eliminates.

Noise (anything that interferes with or distorts the message) reduces information by increasing uncertainty.

Redundancy (predictability or repetition of the message) reduces loss of information due to noise.

Channel Capacity

Previous slide

Next slide

Back to first slide

View graphic version