Claude Elwood Shannon
The life of Claude Elwood Shannon - The Father of the Bit.
Information Entropy
The measure of uncertainty or information content in a source.
\[ H(X) = - \sum_{i} P(x_i) \log_2 P(x_i) \]
Channel Capacity
The upper bound on the rate of information transmission.
\[ C = B \log_2\left(1 + \frac{S}{N}\right) \]
Sources: https://mathshistory.st-andrews.ac.uk/Biographies/Shannon/
