Entropy
Entropy measures the expected negative log probability under a distribution. Higher entropy indicates greater uncertainty within the chosen outcome space, not disorder in every informal sense.
H(p)=-\sum_i p_i\log p_i
Overview. Entropy measures the expected negative log probability under a distribution.
Context. Higher entropy indicates greater uncertainty within the chosen outcome space, not disorder in every informal sense.
Claims and evidence
Claim ledger, 2Entropy measures the expected negative log probability under a distribution.
Higher entropy indicates greater uncertainty within the chosen outcome space, not disorder in every informal sense.