Nested sampling for general Bayesian computation
John Skilling · Bayesian Analysis · 2006
Nested sampling estimates directly how the likelihood function relates to prior mass. The evidence (alternatively the marginal likelihood, marginal density of the data, or the prior predictive) is immediately obtained by summation. It is the prime result of the computation, and is accompanied by an estimate of numerical uncertainty. Samples from the posterior distribution are an optional by-product, obtainable for any temperature. The method relies on sampling within a hard constraint on likelihood value, as opposed to the softened likelihood of annealing methods. Progress depends only on the shape of the "nested" contours of likelihood, and not on the likelihood values. This invariance (over monotonic re-labelling) allows the method to deal with a class of phase-change problems which effectively defeat thermal annealing.
Cited by 1,670 works. doi:10.1214/06-ba127 Open-access PDF
Authors
References
- Equation of State Calculations by Fast Computing Machines
- Information Theory
- Monte Carlo sampling methods using Markov chains and their applications
- Information theory, inference, and learning algorithms
- Hybrid Monte Carlo
- Exact sampling with coupled Markov chains and applications to statistical mechanics
- Multicanonical algorithms for first order phase transitions
- Slice Sampling
- Simulating normalizing constants: from importance sampling to bridge sampling to path sampling
- Machine Calculation of Thermodynamic Properties of a Simple Fluid at Supercritical Temperatures