Learning to Borrow – Relation Representation for Without-Mention Entity-Pairs for Knowledge Graph Completion

04/27/2022
by   Huda Hakami, et al.
0

Prior work on integrating text corpora with knowledge graphs (KGs) to improve Knowledge Graph Embedding (KGE) have obtained good performance for entities that co-occur in sentences in text corpora. Such sentences (textual mentions of entity-pairs) are represented as Lexicalised Dependency Paths (LDPs) between two entities. However, it is not possible to represent relations between entities that do not co-occur in a single sentence using LDPs. In this paper, we propose and evaluate several methods to address this problem, where we borrow LDPs from the entity pairs that co-occur in sentences in the corpus (i.e. with mention entity pairs) to represent entity pairs that do not co-occur in any sentence in the corpus (i.e. without mention entity pairs). We propose a supervised borrowing method, SuperBorrow, that learns to score the suitability of an LDP to represent a without-mention entity pair using pre-trained entity embeddings and contextualised LDP representations. Experimental results show that SuperBorrow improves the link prediction performance of multiple widely-used prior KGE methods such as TransE, DistMult, ComplEx and RotatE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/13/2019

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

Pre-trained language representation models (PLMs) learn effective langua...
research
07/09/2018

Jointly Embedding Entities and Text with Distant Supervision

Learning representations for knowledge base entities and concepts is bec...
research
07/28/2023

Select and Augment: Enhanced Dense Retrieval Knowledge Graph Augmentation

Injecting textual information into knowledge graph (KG) entity represent...
research
11/19/2022

Entity-Assisted Language Models for Identifying Check-worthy Sentences

We propose a new uniform framework for text classification and ranking t...
research
02/07/2023

An entity-guided text summarization framework with relational heterogeneous graph neural network

Two crucial issues for text summarization to generate faithful summaries...
research
04/30/2018

Fast and scalable learning of neuro-symbolic representations of biomedical knowledge

In this work we address the problem of fast and scalable learning of neu...
research
11/09/2017

Open-World Knowledge Graph Completion

Knowledge Graphs (KGs) have been applied to many tasks including Web sea...

Please sign up or login with your details

Forgot password? Click here to reset