Contrastive Representation Learning for Cross-Document Coreference Resolution of Events and Entities

05/23/2022
by   Benjamin Hsu, et al.
0

Identifying related entities and events within and across documents is fundamental to natural language understanding. We present an approach to entity and event coreference resolution utilizing contrastive representation learning. Earlier state-of-the-art methods have formulated this problem as a binary classification problem and leveraged large transformers in a cross-encoder architecture to achieve their results. For large collections of documents and corresponding set of n mentions, the necessity of performing n^2 transformer computations in these earlier approaches can be computationally intensive. We show that it is possible to reduce this burden by applying contrastive learning techniques that only require n transformer computations at inference time. Our method achieves state-of-the-art results on a number of key metrics on the ECB+ corpus and is competitive on others.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2020

Paired Representation Learning for Event and Entity Coreference

Co-reference of Events and of Entities are commonly formulated as binary...
research
10/20/2021

Contrastive Document Representation Learning with Graph Attention Networks

Recent progress in pretrained Transformer-based language models has show...
research
04/17/2021

Sequential Cross-Document Coreference Resolution

Relating entities and events in text is a key component of natural langu...
research
09/05/2019

Effective Use of Transformer Networks for Entity Tracking

Tracking entities in procedural language requires understanding the tran...
research
12/05/2020

Cross-Domain Sentiment Classification with In-Domain Contrastive Learning

Contrastive learning (CL) has been successful as a powerful representati...
research
10/11/2021

Focus on what matters: Applying Discourse Coherence Theory to Cross Document Coreference

Performing event and entity coreference resolution across documents vast...
research
12/21/2021

Max-Margin Contrastive Learning

Standard contrastive learning approaches usually require a large number ...

Please sign up or login with your details

Forgot password? Click here to reset