ICLEA: Interactive Contrastive Learning for Self-supervised Entity Alignment

01/17/2022
by   Kaisheng Zeng, et al.
0

Self-supervised entity alignment (EA) aims to link equivalent entities across different knowledge graphs (KGs) without seed alignments. The current SOTA self-supervised EA method draws inspiration from contrastive learning, originally designed in computer vision based on instance discrimination and contrastive loss, and suffers from two shortcomings. Firstly, it puts unidirectional emphasis on pushing sampled negative entities far away rather than pulling positively aligned pairs close, as is done in the well-established supervised EA. Secondly, KGs contain rich side information (e.g., entity description), and how to effectively leverage those information has not been adequately investigated in self-supervised EA. In this paper, we propose an interactive contrastive learning model for self-supervised EA. The model encodes not only structures and semantics of entities (including entity name, entity description, and entity neighborhood), but also conducts cross-KG contrastive learning by building pseudo-aligned entity pairs. Experimental results show that our approach outperforms previous best self-supervised results by a large margin (over 9 with previous SOTA supervised counterparts, demonstrating the effectiveness of the interactive contrastive learning for self-supervised EA.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/17/2021

A Self-supervised Method for Entity Alignment

Entity alignment, aiming to identify equivalent entities across differen...
research
03/02/2022

SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs

Entity alignment, aiming to identify equivalent entities across differen...
research
09/02/2022

Multi-modal Contrastive Representation Learning for Entity Alignment

Multi-modal entity alignment aims to identify equivalent entities betwee...
research
09/10/2021

Attention-based Contrastive Learning for Winograd Schemas

Self-supervised learning has recently attracted considerable attention i...
research
06/11/2021

A comprehensive solution to retrieval-based chatbot construction

In this paper we present the results of our experiments in training and ...
research
09/02/2021

Self-supervised Recommendation with Cross-channel Matching Representation and Hierarchical Contrastive Learning

Recently, using different channels to model social semantic information,...
research
04/17/2022

Addressing Leakage in Self-Supervised Contextualized Code Retrieval

We address contextualized code retrieval, the search for code snippets h...

Please sign up or login with your details

Forgot password? Click here to reset