Machine Reading Tea Leaves: Automatically Evaluating Topic Coherence and Topic Model Quality
Jey Han Lau, David Newman, Timothy J. Baldwin · Conference of the European Chapter of the Association for Computational Linguistics · 2014
Topic models based on latent Dirichlet al-location and related methods are used in a range of user-focused tasks including doc-ument navigation and trend analysis, but evaluation of the intrinsic quality of the topic model and topics remains an open research area. In this work, we explore the two tasks of automatic evaluation of single topics and automatic evaluation of whole topic models, and provide recom-mendations on the best strategy for per-forming the two tasks, in addition to pro-viding an open-source toolkit for topic and topic model evaluation. 1
Cited by 571 works. doi:10.3115/v1/e14-1056
Authors
References
- Latent dirichlet allocation
- Probabilistic Latent Semantic Indexing
- Training linear SVMs in linear time
- Reading Tea Leaves: How Humans Interpret Topic Models
- Correlated Topic Models
- Optimizing Semantic Coherence in Topic Models
- Applied morphological processing of English
- Automatic evaluation of topic coherence
- Normalized (pointwise) mutual information in collocation extraction
- Studying the history of ideas using topic models