Fact or Fiction: Verifying Scientific Claims

04/30/2020
by   David Wadden, et al.
0

We introduce the task of scientific fact-checking. Given a corpus of scientific articles and a claim about a scientific finding, a fact-checking model must identify abstracts that support or refute the claim. In addition, it must provide rationales for its predictions in the form of evidentiary sentences from the retrieved abstracts. For this task, we introduce SciFact, a dataset of 1.4K expert-written scientific claims paired with evidence-containing abstracts, and annotated with labels and rationales. We present a baseline model and assess its performance on SciFact. We observe that, while fact-checking models trained on Wikipedia articles or political news have difficulty generalizing to our task, simple domain adaptation techniques represent a promising avenue for improvement. Finally, we provide initial results showing how our model can be used to verify claims relevant to COVID-19 on the CORD-19 corpus. Our dataset will be made publicly available at https://scifact.apps.allenai.org.

READ FULL TEXT

page 12

page 16

research
05/29/2023

Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidence

We present a new fact-checking benchmark, Check-COVID, that requires sys...
research
10/15/2021

DialFact: A Benchmark for Fact-Checking in Dialogue

Fact-checking is an essential tool to mitigate the spread of misinformat...
research
01/26/2022

CsFEVER and CTKFacts: Czech Datasets for Fact Verification

In this paper, we present two Czech datasets for automated fact-checking...
research
12/27/2018

Uni-DUE Student Team: Tackling fact checking through decomposable attention neural network

In this paper we present our system for the FEVER Challenge. The task of...
research
02/23/2023

Automated Statement Extraction from Press Briefings

Scientific press briefings are a valuable information source. They consi...
research
05/14/2022

Generating Literal and Implied Subquestions to Fact-check Complex Claims

Verifying complex political claims is a challenging task, especially whe...
research
10/25/2021

SciClops: Detecting and Contextualizing Scientific Claims for Assisting Manual Fact-Checking

This paper describes SciClops, a method to help combat online scientific...

Please sign up or login with your details

Forgot password? Click here to reset