KERMIT – A Transformer-Based Approach for Knowledge Graph Matching

04/29/2022
by   Sven Hertling, et al.
0

One of the strongest signals for automated matching of knowledge graphs and ontologies are textual concept descriptions. With the rise of transformer-based language models, text comparison based on meaning (rather than lexical features) is available to researchers. However, performing pairwise comparisons of all textual descriptions of concepts in two knowledge graphs is expensive and scales quadratically (or even worse if concepts have more than one description). To overcome this problem, we follow a two-step approach: we first generate matching candidates using a pre-trained sentence transformer (so called bi-encoder). In a second step, we use fine-tuned transformer cross-encoders to generate the best candidates. We evaluate our approach on multiple datasets and show that it is feasible and produces competitive results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2021

Matching with Transformers in MELT

One of the strongest signals for automated matching of ontologies and kn...
research
10/06/2022

DBkWik++ – Multi Source Matching of Knowledge Graphs

Large knowledge graphs like DBpedia and YAGO are always based on the sam...
research
03/17/2022

Enhanced Temporal Knowledge Embeddings with Contextualized Language Representations

With the emerging research effort to integrate structured and unstructur...
research
08/04/2022

Integrating Knowledge Graph embedding and pretrained Language Models in Hypercomplex Spaces

Knowledge Graphs, such as Wikidata, comprise structural and textual know...
research
07/06/2023

LEA: Improving Sentence Similarity Robustness to Typos Using Lexical Attention Bias

Textual noise, such as typos or abbreviations, is a well-known issue tha...
research
02/06/2023

Controllable Lexical Simplification for English

Fine-tuning Transformer-based approaches have recently shown exciting re...
research
02/18/2022

Unleashing the Power of Transformer for Graphs

Despite recent successes in natural language processing and computer vis...

Please sign up or login with your details

Forgot password? Click here to reset