Neural Media Bias Detection Using Distant Supervision With BABE – Bias Annotations By Experts

09/29/2022
by   Timo Spinde, et al.
0

Media coverage has a substantial effect on the public perception of events. Nevertheless, media outlets are often biased. One way to bias news articles is by altering the word choice. The automatic identification of bias by word choice is challenging, primarily due to the lack of a gold standard data set and high context dependencies. This paper presents BABE, a robust and diverse data set created by trained experts, for media bias research. We also analyze why expert labeling is essential within this domain. Our data set offers better annotation quality and higher inter-annotator agreement than existing work. It consists of 3,700 sentences balanced among topics and outlets, containing media bias labels on the word and sentence level. Based on our data, we also introduce a way to detect bias-inducing sentences in news articles automatically. Our best performing BERT-based model is pre-trained on a larger corpus consisting of distant labels. Fine-tuning and evaluating the model on our proposed supervised data set, we achieve a macro F1-score of 0.804, outperforming existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/26/2021

An Interdisciplinary Approach for the Automated Detection and Visualization of Media Bias in News Articles

Media coverage has a substantial effect on the public perception of even...
research
05/20/2021

MBIC – A Media Bias Annotation Dataset Including Annotator Characteristics

Many people consider news articles to be a reliable source of informatio...
research
05/22/2022

A Domain-adaptive Pre-training Approach for Language Bias Detection in News

Media bias is a multi-faceted construct influencing individual behavior ...
research
11/07/2022

Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles

Media has a substantial impact on the public perception of events. A one...
research
12/14/2021

Do You Think It's Biased? How To Ask For The Perception Of Media Bias

Media coverage possesses a substantial effect on the public perception o...
research
10/20/2020

Detecting Media Bias in News Articles using Gaussian Bias Distributions

Media plays an important role in shaping public opinion. Biased media ca...
research
09/12/2023

Characterizing Latent Perspectives of Media Houses Towards Public Figures

Media houses reporting on public figures, often come with their own bias...

Please sign up or login with your details

Forgot password? Click here to reset