Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications

09/19/2022
by   Tornike Tsereteli, et al.
0

In this paper, we provide an overview of the SV-Ident shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/17/2021

Overview and Insights from the SciVer Shared Task on Scientific Claim Verification

We present an overview of the SciVer shared task, presented at the 2nd S...
research
09/16/2022

Findings of the Shared Task on Multilingual Coreference Resolution

This paper presents an overview of the shared task on multilingual coref...
research
06/09/2017

Overview of the NLPCC 2017 Shared Task: Chinese News Headline Categorization

In this paper, we give an overview for the shared task at the CCF Confer...
research
07/23/2019

Overview and Results: CL-SciSumm Shared Task 2019

The CL-SciSumm Shared Task is the first medium-scale shared task on scie...
research
09/02/2019

The CL-SciSumm Shared Task 2018: Results and Key Insights

This overview describes the official results of the CL-SciSumm Shared Ta...
research
08/29/2019

CCKS 2019 Shared Task on Inter-Personal Relationship Extraction

The CCKS2019 shared task was devoted to inter-personal relationship extr...
research
07/12/2023

ACTI at EVALITA 2023: Overview of the Conspiracy Theory Identification Task

Conspiracy Theory Identication task is a new shared task proposed for th...

Please sign up or login with your details

Forgot password? Click here to reset