Factual or Biased? Predicting Sentence-Level Factuality and Bias of News

01/27/2023
by   Francielle Vargas, et al.
0

We present a study on sentence-level factuality and bias of news articles across domains. While prior work in NLP has mainly focused on predicting the factuality of article-level news reporting and political-ideological bias of news media, we investigated the effects of framing bias in factual reporting across domains so as to predict factuality and bias at the sentence level, which may explain more accurately the overall reliability of the entire document. First, we manually produced a large sentence-level annotated dataset, titled FactNews, composed of 6,191 sentences from 100 news stories by three different outlets, resulting in 300 news articles. Further, we studied how biased and factual spans surface in news articles from different media outlets and different domains. Lastly, a baseline model for factual sentence prediction was presented by fine-tuning BERT. We also provide a detailed analysis of data demonstrating the reliability of the annotation and models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2019

In Plain Sight: Media Bias Through the Lens of Factual Reporting

The increasing prevalence of political bias in news media calls for grea...
research
10/20/2020

Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularity

Media organizations bear great reponsibility because of their considerab...
research
07/16/2023

It's All Relative: Interpretable Models for Scoring Bias in Documents

We propose an interpretable model to score the bias present in web docum...
research
09/14/2023

Connecting the Dots in News Analysis: A Cross-Disciplinary Survey of Media Bias and Framing

The manifestation and effect of bias in news reporting have been central...
research
04/05/2023

Disentangling Structure and Style: Political Bias Detection in News by Inducing Document Hierarchy

We address an important gap in detection of political bias in news artic...
research
05/20/2021

Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Bias

Traditional media outlets are known to report political news in a biased...
research
01/25/2022

Modeling Multi-level Context for Informational Bias Detection by Contrastive Learning and Sentential Graph Network

Informational bias is widely present in news articles. It refers to prov...

Please sign up or login with your details

Forgot password? Click here to reset