The Referential Reader: A Recurrent Entity Network for Anaphora Resolution

02/05/2019
by   Fei Liu, et al.
0

We present a new architecture for storing and accessing entity mentions during online text processing. While reading the text, entity references are identified, and may be stored by either updating or overwriting a cell in a fixed-length memory. The update operation implies coreference with the other mentions that are stored in the same cell; the overwrite operations causes these mentions to be forgotten. By encoding the memory operations as differentiable gates, it is possible to train the model end-to-end, using both a supervised anaphora resolution objective as well as a supplementary language modeling objective. Evaluation on a dataset of pronoun-name anaphora demonstrates that the model achieves state-of-the-art performance with purely left-to-right processing of the text.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/13/2018

Neural Coreference Resolution with Deep Biaffine Attention by Joint Mention Detection and Mention Clustering

Coreference resolution aims to identify in a text all mentions that refe...
research
08/02/2017

Dynamic Entity Representations in Neural Language Models

Understanding a long document requires tracking how entities are introdu...
research
05/28/2020

Empirical Evaluation of Pretraining Strategies for Supervised Entity Linking

In this work, we present an entity linking model which combines a Transf...
research
06/08/2018

Representation Learning of Entities and Documents from Knowledge Base Descriptions

In this paper, we describe TextEnt, a neural network model that learns d...
research
04/19/2019

Constant-Time Machine Translation with Conditional Masked Language Models

Most machine translation systems generate text autoregressively, by sequ...
research
11/03/2022

Circling Back to Recurrent Models of Language

Just because some purely recurrent models suffer from being hard to opti...
research
04/30/2020

Revisiting Memory-Efficient Incremental Coreference Resolution

We explore the task of coreference resolution under fixed memory by exte...

Please sign up or login with your details

Forgot password? Click here to reset