Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings

01/14/2022
by   Ningyu Zhang, et al.
0

Previous knowledge graph embedding approaches usually map entities to representations and utilize score functions to predict the target entities, yet they struggle to reason rare or emerging unseen entities. In this paper, we propose kNN-KGE, a new knowledge graph embedding approach, by linearly interpolating its entity distribution with k-nearest neighbors. We compute the nearest neighbors based on the distance in the entity embedding space from the knowledge store. Our approach can allow rare or emerging entities to be memorized explicitly rather than implicitly in model parameters. Experimental results demonstrate that our approach can improve inductive and transductive link prediction results and yield better performance for low-resource settings with only a few triples, which might be easier to reason via explicit memory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2022

InterHT: Knowledge Graph Embeddings by Interaction between Head and Tail Entities

Knowledge graph embedding (KGE) models learn the representation of entit...
research
04/29/2022

PIE: a Parameter and Inference Efficient Solution for Large Scale Knowledge Graph Embedding Reasoning

Knowledge graph (KG) embedding methods which map entities and relations ...
research
04/07/2015

Large Margin Nearest Neighbor Embedding for Knowledge Representation

Traditional way of storing facts in triplets ( head_entity, relation, ta...
research
10/14/2020

Explaining Creative Artifacts

Human creativity is often described as the mental process of combining a...
research
03/22/2023

From Wide to Deep: Dimension Lifting Network for Parameter-efficient Knowledge Graph Embedding

Knowledge graph embedding (KGE) that maps entities and relations into ve...
research
10/28/2020

DisenE: Disentangling Knowledge Graph Embeddings

Knowledge graph embedding (KGE), aiming to embed entities and relations ...
research
03/17/2021

Capturing Knowledge of Emerging Entities From Extended Search Snippets

Google and other search engines feature the entity search by representin...

Please sign up or login with your details

Forgot password? Click here to reset