Polylingual topic models
David Mimno, Hanna Wallach, Jason Naradowsky et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2009
Topic models are a useful tool for analyzing large text collections, but have previously been applied in only monolingual, or at most bilingual, contexts. Meanwhile, massive collections of interlinked documents in dozens of languages, such as Wikipedia, are now widely available, calling for tools that can characterize content in many languages. We introduce a polylingual topic model that discovers topics aligned across multiple languages. We explore the model's characteristics using two large corpora, each with over ten different languages, and demonstrate its usefulness in supporting machine translation and tracking topic trends across languages.
Cited by 328 works. doi:10.3115/1699571.1699627 Open-access PDF
Authors
References
- Latent dirichlet allocation
- The mathematics of statistical machine translation: parameter estimation
- Latent Dirichlet Allocation
- Modeling annotated data
- The mathematics of statistical machine translation
- LDA-based document models for ad-hoc retrieval
- Evaluation methods for topic models
- Topic and role discovery in social networks
- Modeling annotated data
- Learning Bilingual Lexicons from Monolingual Corpora