CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Media

01/21/2020
by   Alberto Barron-Cedeno, et al.
14

We describe the third edition of the CheckThat! Lab, which is part of the 2020 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes four complementary tasks and a related task from previous lab editions, offered in English, Arabic, and Spanish. Task 1 asks to predict which tweets in a Twitter stream are worth fact-checking. Task 2 asks to determine whether a claim posted in a tweet can be verified using a set of previously fact-checked claims. Task 3 asks to retrieve text snippets from a given set of Web pages that would be useful for verifying a target tweet's claim. Task 4 asks to predict the veracity of a target tweet's claim using a set of Web pages and potentially useful snippets in them. Finally, the lab offers a fifth task that asks to predict the check-worthiness of the claims made in English political debates and speeches. CheckThat! features a full evaluation framework. The evaluation is carried out using mean average precision or precision at rank k for ranking tasks, and F1 for classification tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2020

Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media

We present an overview of the third edition of the CheckThat! Lab at CLE...
research
08/08/2018

Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthiness

We present an overview of the CLEF-2018 CheckThat! Lab on Automatic Iden...
research
09/05/2020

Accenture at CheckThat! 2020: If you say so: Post-hoc fact-checking of claims using transformer-based models

We introduce the strategies used by the Accenture Team for the CLEF2020 ...
research
07/12/2021

Accenture at CheckThat! 2021: Interesting claim identification and ranking with contextually sensitive lexical training data augmentation

This paper discusses the approach used by the Accenture Team for CLEF202...
research
07/15/2022

Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text

The wide use of social media and digital technologies facilitates sharin...
research
10/27/2021

FacTeR-Check: Semi-automated fact-checking through Semantic Similarity and Natural Language Inference

Our society produces and shares overwhelming amounts of information thro...
research
08/04/2019

Automatic Fact-Checking Using Context and Discourse Information

We study the problem of automatic fact-checking, paying special attentio...

Please sign up or login with your details

Forgot password? Click here to reset