DeepAI AI Chat
Log In Sign Up

KnowBias: A Novel AI Method to Detect Polarity in Online Content

by   Aditya Saligrama, et al.

We introduce KnowBias, a system for detecting the degree of political bias in textual content such as social media posts and news articles. In the space of scalable text classification, a common problem is domain mismatch, where easily accessible training data (i.e., tweets) does not correspond in format to the desired testing domain (i.e., longer form article content). While universal text encoders such as word or sentence embeddings could be leveraged to train target agnostic classifiers, such schemes result in poor performance on long-form articles. Our key insight is that long-form articles are a mix of neutral and political sentences, while tweets are concentrated with opinion. We propose a two-step classification system that first automatically filters out neutral sentences from the input text document at evaluation time, and then the resulting text is input into a polarity classifier. We evaluate our two-step approach using a variety of test suites, including a set of tweets and long-form articles where annotations were crowd-sourced to decrease label noise, measuring accuracy and Spearman-rho rank correlation. In practice, KnowBias achieves a high accuracy of 86 (rho = 0.69) on long-form articles.


KnowBias: Detecting Political Polarity in Long Text Content

We introduce a classification scheme for detecting political bias in lon...

Newswire versus Social Media for Disaster Response and Recovery

In a disaster situation, first responders need to quickly acquire situat...

Linking Tweets with Monolingual and Cross-Lingual News using Transformed Word Embeddings

Social media platforms have grown into an important medium to spread inf...

Comparison of Quality Indicators in User-generated Content Using Social Media and Scholarly Text

Predicting the quality of a text document is a critical task when presen...

Political Depolarization of News Articles Using Attribute-aware Word Embeddings

Political polarization in the US is on the rise. This polarization negat...

An Empirical Study of Sections in Classifying Disease Outbreak Reports

Identifying articles that relate to infectious diseases is a necessary s...

Did They Really Tweet That? Querying Fact-Checking Sites and Politwoops to Determine Tweet Misattribution

Screenshots of social media posts have become common place on social med...