Can we Fix the Scope for Coreference? Problems and Solutions for Benchmarks beyond OntoNotes

12/17/2021
by   Amir Zeldes, et al.
0

Current work on automatic coreference resolution has focused on the OntoNotes benchmark dataset, due to both its size and consistency. However many aspects of the OntoNotes annotation scheme are not well understood by NLP practitioners, including the treatment of generic NPs, noun modifiers, indefinite anaphora, predication and more. These often lead to counterintuitive claims, results and system behaviors. This opinion piece aims to highlight some of the problems with the OntoNotes rendition of coreference, and to propose a way forward relying on three principles: 1. a focus on semantics, not morphosyntax; 2. cross-linguistic generalizability; and 3. a separation of identity and scope, which can resolve old problems involving temporal and modal domain consistency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2023

Strengthening Consistency Results in Modal Logic

A fundamental question asked in modal logic is whether a given theory is...
research
03/02/2022

Protecting Celebrities with Identity Consistency Transformer

In this work we propose Identity Consistency Transformer, a novel face f...
research
12/12/2018

An Empirical Study on Decision making for Quality Requirements

[Context] Quality requirements are important for product success yet oft...
research
12/13/2021

Plurality and Quantification in Graph Representation of Meaning

In this thesis we present a semantic representation formalism based on d...
research
03/22/2019

A Type-coherent, Expressive Representation as an Initial Step to Language Understanding

A growing interest in tasks involving language understanding by the NLP ...
research
02/18/2016

Overview of Annotation Creation: Processes & Tools

Creating linguistic annotations requires more than just a reliable annot...
research
09/25/2021

Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?

We analyze the grounded SCAN (gSCAN) benchmark, which was recently propo...

Please sign up or login with your details

Forgot password? Click here to reset