Learning Effective and Interpretable Semantic Models using Non-Negative Sparse Embedding
Brian Murphy, Partha Pratim Talukdar, Tom M. Mitchell · Research Portal (Queen's University Belfast) · 2012
In this paper, we introduce an application of matrix factorization to produce corpus-derived, distributional models of semantics that demonstrate cognitive plausibility. We find that word representations learned by Non-Negative Sparse Embedding (NNSE), a variant of matrix factorization, are sparse, effective, and highly interpretable. To the best of our knowledge, this is the first approach which yields semantic representation of words satisfying these three desirable properties. Though extensive experimental evaluations on multiple real-world tasks and datasets, we demonstrate the superiority of semantic models learned by NNSE over other state-of-the-art baselines.
Cited by 139 works. Open-access PDF
Authors
References
- Indexing by latent semantic analysis
- Latent dirichlet allocation
- The Elements of Statistical Learning
- A unified architecture for natural language processing
- Introduction to WordNet: An On-line Lexical Database *
- A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge.
- Atomic Decomposition by Basis Pursuit
- Word Representations: A Simple and General Method for Semi-Supervised Learning
- Category norms of verbal items in 56 categories A replication and extension of the Connecticut category norms.
- From Frequency to Meaning: Vector Space Models of Semantics