Written by Alexei Gilchrist, updated months ago
A definition of information is introduced which leads to yet another connection with entropy.
Level: 2, Subjects: Information Theory Probability

1 Shannon Information

To be completed

What should be called "information" is defined, and the relationship to entropy arises naturally as the average information.