Evaluation methods for topic models
Hanna Wallach, Iain Murray, Ruslan Salakhutdinov et al. · International Conference on Machine Learning · 2009
A natural evaluation metric for statistical topic models is the probability of held-out documents given a trained model. While exact computation of this probability is intractable, several estimators for this probability have been used in the topic modeling literature, including the harmonic mean method and empirical likelihood method. In this paper, we demonstrate experimentally that commonly-used methods are unlikely to accurately estimate the probability of held-out documents, and propose two alternative methods that are both accurate and efficient.
Cited by 863 works. doi:10.1145/1553374.1553515
Authors
References
- Latent dirichlet allocation
- Finding scientific topics
- Hierarchical Dirichlet Processes
- Annealed importance sampling
- The author-topic model for authors and documents
- Marginal Likelihood from the Gibbs Output
- Approximate Bayesian Inference with the Weighted Likelihood Bootstrap
- Integrating Topics and Syntax
- Topic modeling
- Pachinko allocation