Using Automatically Extracted Minimum Spans to Disentangle Coreference Evaluation from Boundary Detection

06/16/2019
by   Nafise Sadat Moosavi, et al.
0

The common practice in coreference resolution is to identify and evaluate the maximum span of mentions. The use of maximum spans tangles coreference evaluation with the challenges of mention boundary detection like prepositional phrase attachment. To address this problem, minimum spans are manually annotated in smaller corpora. However, this additional annotation is costly and therefore, this solution does not scale to large corpora. In this paper, we propose the MINA algorithm for automatically extracting minimum spans to benefit from minimum span evaluation in all corpora. We show that the extracted minimum spans by MINA are consistent with those that are manually annotated by experts. Our experiments show that using minimum spans is in particular important in cross-dataset coreference evaluation, in which detected mention boundaries are noisier due to domain shift. We will integrate MINA into https://github.com/ns-moosavi/coval for reporting standard coreference scores based on both maximum and automatically detected minimum spans.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/09/2021

Semantic Search as Extractive Paraphrase Span Detection

In this paper, we approach the problem of semantic search by framing the...
research
03/03/2023

T360RRD: A dataset for 360 degree rotated rectangular box table detection

To address the problem of scarcity and high annotation costs of rotated ...
research
06/11/2019

A Linear Algorithm for Minimum Dominator Colorings of Orientations of Paths

In this paper we present an algorithm for finding a minimum dominator co...
research
01/09/2021

Active Fire Detection in Landsat-8 Imagery: a Large-Scale Dataset and a Deep-Learning Study

Active fire detection in satellite imagery is of critical importance to ...
research
07/28/2017

Improving coreference resolution with automatically predicted prosodic information

Adding manually annotated prosodic information, specifically pitch accen...
research
08/23/2019

VOP Detection for Read and Conversation Speech using CWT Coefficients and Phone Boundaries

In this paper, we propose a novel approach for accurate detection of the...
research
07/28/2023

SAFE: Saliency-Aware Counterfactual Explanations for DNN-based Automated Driving Systems

A CF explainer identifies the minimum modifications in the input that wo...

Please sign up or login with your details

Forgot password? Click here to reset