Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models

09/07/2020
by   Alex Nikolov, et al.
0

While misinformation and disinformation have been thriving in social media for years, with the emergence of the COVID-19 pandemic, the political and the health misinformation merged, thus elevating the problem to a whole new level and giving rise to the first global infodemic. The fight against this infodemic has many aspects, with fact-checking and debunking false and misleading claims being among the most important ones. Unfortunately, manual fact-checking is time-consuming and automatic fact-checking is resource-intense, which means that we need to pre-filter the input social media posts and to throw out those that do not appear to be check-worthy. With this in mind, here we propose a model for detecting check-worthy tweets about COVID-19, which combines deep contextualized text representations with modeling the social context of the tweet. We further describe a number of additional experiments and comparisons, which we believe should be useful for future research as they provide some indication about what techniques are effective for the task. Our official submission to the English version of CLEF-2020 CheckThat! Task 1, system Team_Alex, was ranked second with a MAP score of 0.8034, which is almost tied with the wining system, lagging behind by just 0.003 MAP points absolute.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2022

Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text

The wide use of social media and digital technologies facilitates sharin...
research
12/16/2020

Checking Fact Worthiness using Sentence Embeddings

Checking and confirming factual information in texts and speeches is vit...
research
10/27/2021

FacTeR-Check: Semi-automated fact-checking through Semantic Similarity and Natural Language Inference

Our society produces and shares overwhelming amounts of information thro...
research
11/17/2022

Did They Really Tweet That? Querying Fact-Checking Sites and Politwoops to Determine Tweet Misattribution

Screenshots of social media posts have become common place on social med...
research
12/19/2022

Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments

We present a human-in-the-loop evaluation framework for fact-checking no...

Please sign up or login with your details

Forgot password? Click here to reset