Structured Prediction as Translation between Augmented Natural Languages

by   Giovanni Paolini, et al.

We propose a new framework, Translation between Augmented Natural Languages (TANL), to solve many structured prediction language tasks including joint entity and relation extraction, nested named entity recognition, relation classification, semantic role labeling, event extraction, coreference resolution, and dialogue state tracking. Instead of tackling the problem by training task-specific discriminative classifiers, we frame it as a translation task between augmented natural languages, from which the task-relevant information can be easily extracted. Our approach can match or outperform task-specific models on all tasks, and in particular, achieves new state-of-the-art results on joint entity and relation extraction (CoNLL04, ADE, NYT, and ACE2005 datasets), relation classification (FewRel and TACRED), and semantic role labeling (CoNLL-2005 and CoNLL-2012). We accomplish this while using the same architecture and hyperparameters for all tasks and even when training a single model to solve all tasks at the same time (multi-task learning). Finally, we show that our framework can also significantly improve the performance in a low-resource regime, thanks to better use of label semantics.


page 1

page 2

page 3

page 4


DeepStruct: Pretraining of Language Models for Structure Prediction

We introduce a method for improving the structural understanding abiliti...

An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learning

We present a joint model for entity-level relation extraction from docum...

Augmented Natural Language for Generative Sequence Labeling

We propose a generative framework for joint sequence labeling and senten...

Deeper Task-Specificity Improves Joint Entity and Relation Extraction

Multi-task learning (MTL) is an effective method for learning related ta...

A Partition Filter Network for Joint Entity and Relation Extraction

In joint entity and relation extraction, existing work either sequential...

MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extraction

Neural relation extraction models have shown promising results in recent...

Unified Semantic Typing with Meaningful Label Inference

Semantic typing aims at classifying tokens or spans of interest in a tex...

Code Repositories