Streamlining Cross-Document Coreference Resolution: Evaluation and Modeling

09/23/2020
by   Arie Cattan, et al.
0

Recent evaluation protocols for Cross-document (CD) coreference resolution have often been inconsistent or lenient, leading to incomparable results across works and overestimation of performance. To facilitate proper future research on this task, our primary contribution is proposing a pragmatic evaluation methodology which assumes access to only raw text – rather than assuming gold mentions, disregards singleton prediction, and addresses typical targeted settings in CD coreference resolution. Aiming to set baseline results for future research that would follow our evaluation methodology, we build the first end-to-end model for this task. Our model adapts and extends recent neural models for within-document coreference resolution to address the CD coreference setting, which outperforms state-of-the-art results by a significant margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2021

Cross-document Coreference Resolution over Predicted Mentions

Coreference resolution has been mostly investigated within a single docu...
research
04/11/2021

WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia

Cross-document event coreference resolution is a foundational task for N...
research
06/08/2021

Realistic Evaluation Principles for Cross-document Coreference Resolution

We point out that common evaluation practices for cross-document corefer...
research
04/17/2021

Sequential Cross-Document Coreference Resolution

Relating entities and events in text is a key component of natural langu...
research
11/24/2020

Cross-Document Event Coreference Resolution Beyond Corpus-Tailored Systems

Cross-document event coreference resolution (CDCR) is an NLP task in whi...
research
07/18/2018

On Evaluation of Embodied Navigation Agents

Skillful mobile operation in three-dimensional environments is a primary...
research
09/20/2020

Understanding Mention Detector-Linker Interaction for Neural Coreference Resolution

Coreference resolution is an important task for discourse-level natural ...

Please sign up or login with your details

Forgot password? Click here to reset