How Good Are SOTA Fake News Detectors

08/04/2023
by   Matthew Iceland, et al.
0

Automatic fake news detection with machine learning can prevent the dissemination of false statements before they gain many views. Several datasets labeling statements as legitimate or false have been created since the 2016 United States presidential election for the prospect of training machine learning models. We evaluate the robustness of both traditional and deep state-of-the-art models to gauge how well they may perform in the real world. We find that traditional models tend to generalize better to data outside the distribution it was trained on compared to more recently-developed large language models, though the best model to use may depend on the specific task at hand.

READ FULL TEXT

page 5

page 6

page 10

page 11

research
11/19/2019

Sieving Fake News From Genuine: A Synopsis

With the rise of social media, it has become easier to disseminate fake ...
research
07/23/2023

X-CapsNet For Fake News Detection

News consumption has significantly increased with the growing popularity...
research
12/13/2022

AdvCat: Domain-Agnostic Robustness Assessment for Cybersecurity-Critical Applications with Categorical Inputs

Machine Learning-as-a-Service systems (MLaaS) have been largely develope...
research
12/11/2018

Socratrees: Make Discussions Great Again

Terms like `misinformation', `fake news', and `echo chambers' permeate c...
research
04/26/2023

The Internal State of an LLM Knows When its Lying

While Large Language Models (LLMs) have shown exceptional performance in...
research
08/13/2020

Studying Dishonest Intentions in Brazilian Portuguese Texts

Previous work in the social sciences, psychology and linguistics has sho...
research
08/22/2022

Fake News Identification using Machine Learning Algorithms Based on Graph Features

The spread of fake news has long been a social issue and the necessity o...

Please sign up or login with your details

Forgot password? Click here to reset