Cross-Lingual Relation Extraction with Transformers

10/16/2020
by   Jian Ni, et al.
0

Relation extraction (RE) is one of the most important tasks in information extraction, as it provides essential information for many NLP applications. In this paper, we propose a cross-lingual RE approach that does not require any human annotation in a target language or any cross-lingual resources. Building upon unsupervised cross-lingual representation learning frameworks, we develop several deep Transformer based RE models with a novel encoding scheme that can effectively encode both entity location and entity type information. Our RE models, when trained with English data, outperform several deep neural network based English RE models. More importantly, our models can be applied to perform zero-shot cross-lingual RE, achieving the state-of-the-art cross-lingual RE performance on two datasets (68-89 target-language RE model). The high cross-lingual transfer efficiency without requiring additional training data or cross-lingual resources shows that our RE models are especially useful for low-resource languages.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2019

Neural Cross-Lingual Relation Extraction Based on Bilingual Word Embedding Mapping

Relation extraction (RE) seeks to detect and classify semantic relations...
research
03/24/2020

Cross-Lingual Adaptation Using Universal Dependencies

We describe a cross-lingual adaptation method based on syntactic parse t...
research
03/22/2015

Multilingual Open Relation Extraction Using Cross-lingual Projection

Open domain relation extraction systems identify relation and argument p...
research
08/18/2021

Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks

This paper studies the relative importance of attention heads in Transfo...
research
04/25/2021

Identifying Offensive Expressions of Opinion in Context

Classic information extraction techniques consist in building questions ...
research
10/06/2020

GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction

Prevalent approaches in cross-lingual relation and event extraction use ...
research
05/20/2023

Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extraction

Latest efforts on cross-lingual relation extraction (XRE) aggressively l...

Please sign up or login with your details

Forgot password? Click here to reset