How does the Hartley formula differ from the Shannon formula?

To understand how these formulas differ, we will look at them.

Hartley’s formula: I = log2N

Shannon’s formula: I = – (p1log2 p1 + p2 log2 p2 +… + PN log2 pN),

In fact, if the probabilities p1, …, pN are equal, then each of them is equal to 1 / N, and Shannon’s formula turns into Hartley’s formula. But there is a difference in the formulas. Hartley’s formula is not always possible to use to determine the amount of information, unlike Shannon’s formula. This is their difference.



One of the components of a person's success in our time is receiving modern high-quality education, mastering the knowledge, skills and abilities necessary for life in society. A person today needs to study almost all his life, mastering everything new and new, acquiring the necessary professional qualities.