Supervised Topic Models
David M. Blei, Jon McAuliffe · arXiv (Cornell University) · 2010
We introduce supervised latent Dirichlet allocation (sLDA), a statistical model of labelled documents. The model accommodates a variety of response types. We derive an approximate maximum-likelihood procedure for parameter estimation, which relies on variational methods to handle intractable posterior expectations. Prediction problems motivate this research: we use the fitted model to predict response values for new documents. We test sLDA on two real-world problems: movie ratings predicted from reviews, and the political tone of amendments in the U.S. Senate based on the amendment text. We illustrate the benefits of sLDA versus modern regularized regression, as well as versus an unsupervised LDA analysis followed by a separate regression.
Cited by 1,259 works. doi:10.48550/arxiv.1003.0783 Open-access PDF
Authors
References
- Maximum Likelihood from Incomplete Data Via the EM Algorithm
- Generalized Linear Models
- Regression Shrinkage and Selection Via the Lasso
- Latent dirichlet allocation
- The Elements of Statistical Learning
- Book Review: Pattern Recognition and Machine Learning
- Inference of Population Structure Using Multilocus Genotype Data
- An Introduction to Variational Methods for Graphical Models
- A Bayesian Hierarchical Model for Learning Natural Scene Categories
- Seeing stars