A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation
Yee Whye Teh, David J. Newman, Max Welling · 2007
Latent Dirichlet allocation (LDA) is a Bayesian network that has recently gained much popularity in applications ranging from document modeling to computer vision. Due to the large scale nature of these applications, current inference pro-cedures like variational Bayes and Gibbs sampling have been found lacking. In this paper we propose the collapsed variational Bayesian inference algorithm for LDA, and show that it is computationally efficient, easy to implement and signifi-cantly more accurate than standard variational Bayesian inference for LDA. 1
Cited by 490 works. doi:10.21236/ada629956
Authors
References
- Latent dirichlet allocation
- A Bayesian Hierarchical Model for Learning Natural Scene Categories
- Finding scientific topics
- Expectation-propagation for the generative aspect model
- The author-topic model for authors and documents
- A Tutorial on Learning with Bayesian Networks
- Variational Algorithms for Approximate Bayesian Inference
- Pachinko allocation
- Rao-Blackwellisation of sampling schemes
- Variational Extensions to EM and Multinomial PCA