On Contrastive Divergence Learning.
Miguel Á. Carreira-Perpiñán, Geoffrey E. Hinton · 2005
Maximum-likelihood (ML) learning of Markov random fields is challenging because it requires estimates of averages that have an exponential number of terms. Markov chain Monte Carlo methods typically take a long time to converge on unbiased estimates, but Hinton (2002) showed that if the Markov chain is only run for a few steps, the learning can still work well and it approximately minimizes a di#erent function called "contrastive divergence" (CD). CD learning has been successfully applied to various types of random fields. Here, we study the properties of CD learning and show that it provides biased estimates in general, but that the bias is typically very small. Fast CD learning can therefore be used to get close to an ML solution and slow ML learning can then be used to fine-tune the CD solution.
Cited by 571 works.
Authors
References
- Training Products of Experts by Minimizing Contrastive Divergence
- Markov Chain Monte Carlo in Practice
- THE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS
- Information processing in dynamical systems: foundations of harmony theory
- Adaptive Algorithms and Stochastic Approximations
- Multiscale conditional random fields for image labeling
- 10.1162/jmlr.2003.4.7-8.1235
- Stochastic Neighbor Embedding
- Markov Random Field Modeling in Image Analysis
- Continuous restricted Boltzmann machine with an implementable training algorithm