FacTeR-Check: Semi-automated fact-checking through Semantic Similarity and Natural Language Inference

10/27/2021
by   Alejandro Martín, et al.
5

Our society produces and shares overwhelming amounts of information through the Online Social Networks (OSNs). Within this environment, misinformation and disinformation have proliferated, becoming a public safety concern on every country. Allowing the public and professionals to efficiently find reliable evidence about the factual veracity of a claim is crucial to mitigate this harmful spread. To this end, we propose FacTeR-Check, a multilingual architecture for semi-automated fact-checking that can be used for either the general public but also useful for fact-checking organisations. FacTeR-Check enables retrieving fact-checked information, unchecked claims verification and tracking dangerous information over social media. This architectures involves several modules developed to evaluate semantic similarity, to calculate natural language inference and to retrieve information from Online Social Networks. The union of all these modules builds a semi-automated fact-checking tool able of verifying new claims, to extract related evidence, and to track the evolution of a hoax on a OSN. While individual modules are validated on related benchmarks (mainly MSTS and SICK), the complete architecture is validated using a new dataset called NLI19-SP that is publicly released with COVID-19 related hoaxes and tweets from Spanish social media. Our results show state-of-the-art performance on the individual benchmarks, as well as producing useful analysis of the evolution over time of 61 different hoaxes.

READ FULL TEXT

page 2

page 14

research
03/13/2021

Automated Fact-Checking for Assisting Human Fact-Checkers

The reporting and analysis of current events around the globe has expand...
research
09/07/2020

Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models

While misinformation and disinformation have been thriving in social med...
research
02/28/2023

PANACEA: An Automated Misinformation Detection System on COVID-19

In this demo, we introduce a web-based misinformation detection system P...
research
05/29/2023

Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidence

We present a new fact-checking benchmark, Check-COVID, that requires sys...
research
01/21/2020

CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Media

We describe the third edition of the CheckThat! Lab, which is part of th...
research
09/01/2023

FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checking

Automatic fact-checking plays a crucial role in combating the spread of ...
research
08/23/2021

Towards Explainable Fact Checking

The past decade has seen a substantial rise in the amount of mis- and di...

Please sign up or login with your details

Forgot password? Click here to reset