CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning

by   Daojian Zeng, et al.
Kyoto University
University of Illinois at Urbana-Champaign
NetEase, Inc

Joint extraction of entities and relations has received significant attention due to its potential of providing higher performance for both tasks. Among existing methods, CopyRE is effective and novel, which uses a sequence-to-sequence framework and copy mechanism to directly generate the relation triplets. However, it suffers from two fatal problems. The model is extremely weak at differing the head and tail entity, resulting in inaccurate entity extraction. It also cannot predict multi-token entities (e.g. Steven Jobs). To address these problems, we give a detailed analysis of the reasons behind the inaccurate entity extraction problem, and then propose a simple but extremely effective model structure to solve this problem. In addition, we propose a multi-task learning framework equipped with copy mechanism, called CopyMTL, to allow the model to predict multi-token entities. Experiments reveal the problems of CopyRE and show that our model achieves significant improvement over the current state-of-the-art method by 9 and 16


page 1

page 2

page 3

page 4


Joint Extraction of Entities and Relations with a Hierarchical Multi-task Tagging Model

Entity extraction and relation extraction are two indispensable building...

Similarity-based Memory Enhanced Joint Entity and Relation Extraction

Document-level joint entity and relation extraction is a challenging inf...

Joint Extraction of Entities and Relations Based on a Novel Decomposition Strategy

Joint extraction of entities and relations aims to detect entity pairs a...

Document-level Entity-based Extraction as Template Generation

Document-level entity-based extraction (EE), aiming at extracting entity...

Seq2Seq and Multi-Task Learning for joint intent and content extraction for domain specific interpreters

This study evaluates the performances of an LSTM network for detecting a...

Relational Triple Extraction: One Step is Enough

Extracting relational triples from unstructured text is an essential tas...

A shallow neural model for relation prediction

Knowledge graph completion refers to predicting missing triples. Most ap...

Please sign up or login with your details

Forgot password? Click here to reset