Moving on from OntoNotes: Coreference Resolution Model Transfer

04/17/2021
by   Patrick Xia, et al.
0

Academic neural models for coreference resolution are typically trained on a single dataset (OntoNotes) and model improvements are then benchmarked on that dataset. However, real-world usages of coreference resolution models depend on the annotation guidelines and the domain of the target dataset, which often differ from those of OntoNotes. We aim to quantify transferability of coreference resolution models based on the number of annotated documents available in the target dataset. We examine five target datasets and find that continued training is consistently effective and especially beneficial when there are few target documents. We establish new benchmarks across several datasets, including state-of-the-art results on LitBank and PreCo.

READ FULL TEXT
research
09/20/2021

On Generalization in Coreference Resolution

While coreference resolution is defined independently of dataset domain,...
research
01/22/2023

Ensemble Transfer Learning for Multilingual Coreference Resolution

Entity coreference resolution is an important research problem with many...
research
10/05/2022

Schema Encoding for Transferable Dialogue State Tracking

Dialogue state tracking (DST) is an essential sub-task for task-oriented...
research
06/27/2023

UTRNet: High-Resolution Urdu Text Recognition In Printed Documents

In this paper, we propose a novel approach to address the challenges of ...
research
03/16/2023

Investigating Failures to Generalize for Coreference Resolution Models

Coreference resolution models are often evaluated on multiple datasets. ...
research
10/22/2020

Rethinking Evaluation in ASR: Are Our Models Robust Enough?

Is pushing numbers on a single benchmark valuable in automatic speech re...
research
07/20/2017

Revisiting Selectional Preferences for Coreference Resolution

Selectional preferences have long been claimed to be essential for coref...

Please sign up or login with your details

Forgot password? Click here to reset