DeepAI AI Chat
Log In Sign Up

Learning to Borrow – Relation Representation for Without-Mention Entity-Pairs for Knowledge Graph Completion

by   Huda Hakami, et al.
University of Liverpool
Design and Development by:

Prior work on integrating text corpora with knowledge graphs (KGs) to improve Knowledge Graph Embedding (KGE) have obtained good performance for entities that co-occur in sentences in text corpora. Such sentences (textual mentions of entity-pairs) are represented as Lexicalised Dependency Paths (LDPs) between two entities. However, it is not possible to represent relations between entities that do not co-occur in a single sentence using LDPs. In this paper, we propose and evaluate several methods to address this problem, where we borrow LDPs from the entity pairs that co-occur in sentences in the corpus (i.e. with mention entity pairs) to represent entity pairs that do not co-occur in any sentence in the corpus (i.e. without mention entity pairs). We propose a supervised borrowing method, SuperBorrow, that learns to score the suitability of an LDP to represent a without-mention entity pair using pre-trained entity embeddings and contextualised LDP representations. Experimental results show that SuperBorrow improves the link prediction performance of multiple widely-used prior KGE methods such as TransE, DistMult, ComplEx and RotatE.


page 1

page 2

page 3

page 4


KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

Pre-trained language representation models (PLMs) learn effective langua...

Jointly Embedding Entities and Text with Distant Supervision

Learning representations for knowledge base entities and concepts is bec...

Entity-Assisted Language Models for Identifying Check-worthy Sentences

We propose a new uniform framework for text classification and ranking t...

An entity-guided text summarization framework with relational heterogeneous graph neural network

Two crucial issues for text summarization to generate faithful summaries...

Extracting Mathematical Concepts from Text

We investigate different systems for extracting mathematical entities fr...

Open-World Knowledge Graph Completion

Knowledge Graphs (KGs) have been applied to many tasks including Web sea...

Fast and scalable learning of neuro-symbolic representations of biomedical knowledge

In this work we address the problem of fast and scalable learning of neu...