Knowledge Graph Embedding by Translating on Hyperplanes
Zhen Wang, Jianwen Zhang, Jianlin Feng et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2014
We deal with embedding a large scale knowledge graph composed of entities and relations into a continuous vector space. TransE is a promising method proposed recently, which is very efficient while achieving state-of-the-art predictive performance. We discuss some mapping properties of relations which should be considered in embedding, such as reflexive, one-to-many, many-to-one, and many-to-many. We note that TransE does not do well in dealing with these properties. Some complex models are capable of preserving these mapping properties but sacrifice efficiency in the process. To make a good trade-off between model capacity and efficiency, in this paper we propose TransH which models a relation as a hyperplane together with a translation operation on it. In this way, we can well preserve the above mapping properties of relations with almost the same model complexity of TransE. Additionally, as a practical knowledge graph is often far from completed, how to construct negative examples to reduce false negative labels in training is very important. Utilizing the one-to-many/many-to-one mapping property of a relation, we propose a simple trick to reduce the possibility of false negative labeling. We conduct extensive experiments on link prediction, triplet classification and fact extraction on benchmark datasets like WordNet and Freebase. Experiments show TransH delivers significant improvements over TransE on predictive accuracy with comparable capability to scale up.
Cited by 3,725 works. doi:10.1609/aaai.v28i1.8870
Authors
References
- Gene Ontology: tool for the unification of biology
- WordNet
- Distributed Representations of Words and Phrases and their Compositionality
- A unified architecture for natural language processing
- Freebase
- Incorporating non-local information into information extraction systems by Gibbs sampling
- Translating Embeddings for Modeling Multi-relational Data
- Distant supervision for relation extraction without labeled data
- Reasoning With Neural Tensor Networks for Knowledge Base Completion
- A Three-Way Model for Collective Learning on Multi-Relational Data