SciClops: Detecting and Contextualizing Scientific Claims for Assisting Manual Fact-Checking

10/25/2021
by   Panayiotis Smeros, et al.
17

This paper describes SciClops, a method to help combat online scientific misinformation. Although automated fact-checking methods have gained significant attention recently, they require pre-existing ground-truth evidence, which, in the scientific context, is sparse and scattered across a constantly-evolving scientific literature. Existing methods do not exploit this literature, which can effectively contextualize and combat science-related fallacies. Furthermore, these methods rarely require human intervention, which is essential for the convoluted and critical domain of scientific misinformation. SciClops involves three main steps to process scientific claims found in online news articles and social media postings: extraction, clustering, and contextualization. First, the extraction of scientific claims takes place using a domain-specific, fine-tuned transformer model. Second, similar claims extracted from heterogeneous sources are clustered together with related scientific literature using a method that exploits their content and the connections among them. Third, check-worthy claims, broadcasted by popular yet unreliable sources, are highlighted together with an enhanced fact-checking context that includes related verified claims, news articles, and scientific papers. Extensive experiments show that SciClops tackles sufficiently these three steps, and effectively assists non-expert fact-checkers in the verification of complex scientific claims, outperforming commercial fact-checking systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2023

Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidence

We present a new fact-checking benchmark, Check-COVID, that requires sys...
research
04/30/2020

Fact or Fiction: Verifying Scientific Claims

We introduce the task of scientific fact-checking. Given a corpus of sci...
research
03/13/2019

SciLens: Evaluating the Quality of Scientific News Articles Using Social Media and Scientific Literature Indicators

This paper describes, develops, and validates SciLens, a method to evalu...
research
09/27/2021

Expressing High-Level Scientific Claims with Formal Semantics

The use of semantic technologies is gaining significant traction in scie...
research
05/26/2023

Scientific Fact-Checking: A Survey of Resources and Approaches

The task of fact-checking deals with assessing the veracity of factual c...
research
10/24/2022

Modeling Information Change in Science Communication with Semantically Matched Paraphrases

Whether the media faithfully communicate scientific information has long...
research
09/20/2021

What do fact checkers fact-check when?

Recent research suggests that not all fact checking efforts are equal: w...

Please sign up or login with your details

Forgot password? Click here to reset