The CL-SciSumm Shared Task 2018: Results and Key Insights

09/02/2019
by   Kokil Jaidka, et al.
0

This overview describes the official results of the CL-SciSumm Shared Task 2018 – the first medium-scale shared task on scientific document summarization in the computational linguistics (CL) domain. This year, the dataset comprised 60 annotated sets of citing and reference papers from the open access research papers in the CL domain. The Shared Task was organized as a part of the 41st Annual Conference of the Special Interest Group in Information Retrieval (SIGIR), held in Ann Arbor, USA in July 2018. We compare the participating systems in terms of two evaluation metrics. The annotated dataset and evaluation scripts can be accessed and used by the community from: <https://github.com/WING-NUS/scisumm-corpus>.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2019

Overview and Results: CL-SciSumm Shared Task 2019

The CL-SciSumm Shared Task is the first medium-scale shared task on scie...
research
09/19/2022

Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications

In this paper, we provide an overview of the SV-Ident shared task as par...
research
10/12/2020

MedICaT: A Dataset of Medical Images, Captions, and Textual References

Understanding the relationship between figures and text is key to scient...
research
07/17/2021

Overview and Insights from the SciVer Shared Task on Scientific Claim Verification

We present an overview of the SciVer shared task, presented at the 2nd S...
research
03/12/2021

S2AND: A Benchmark and Evaluation System for Author Name Disambiguation

Author Name Disambiguation (AND) is the task of resolving which author m...
research
07/15/2020

Are We There Yet? Evaluating State-of-the-Art Neural Network based Geoparsers Using EUPEG as a Benchmarking Platform

Geoparsing is an important task in geographic information retrieval. A g...
research
09/16/2023

ODSum: New Benchmarks for Open Domain Multi-Document Summarization

Open-domain Multi-Document Summarization (ODMDS) is a critical tool for ...

Please sign up or login with your details

Forgot password? Click here to reset