Computing Entropies with Nested Sampling

The Shannon entropy, and related quantities such as mutual information, can be used to quantify uncertainty and relevance. However, in practice, it can be difficult to compute these quantities for arbitrary probability distributions, particularly if the probability mass functions or densities cannot...

Full description

Bibliographic Details
Main Author: Brendon J. Brewer
Format: Article
Language:English
Published: MDPI AG 2017-08-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/19/8/422