Parameter estimation for text analysis
Gregor Heinrich · 2009
Abstract. Presents parameter estimation methods common with discrete probability distributions, which is of particular interest in text modeling. Starting with maximum likelihood, a posteriori and Bayesian estimation, central concepts like conjugate distributions and Bayesian networks are reviewed. As an application, the model of latent Dirichlet allocation (LDA) is explained in detail with a full derivation of an approximate inference algorithm based on Gibbs sampling, including a discussion of Dirichlet hyperparameter estimation. Finally, analysis methods of LDA models are discussed.
Cited by 695 works.
Authors
References
- Indexing by latent semantic analysis
- Latent dirichlet allocation
- Modern Information Retrieval
- Inference of Population Structure Using Multilocus Genotype Data
- Finding scientific topics
- Information theory, inference, and learning algorithms
- Probabilistic Latent Semantic Analysis
- Hierarchical Dirichlet Processes
- Expectation-propagation for the generative aspect model
- Adaptive Rejection Sampling for Gibbs Sampling