The likelihood that a transmitted symbol is incorrectly decoded.

The maximum number of bits required to encode any outcome of the variable.

The capacity of a noiseless communication channel.

The minimum average number of bits needed to describe the variable's outcomes.