SciLens: Evaluating the Quality of Scientific News Articles Using Social Media and Scientific Literature Indicators

by   Panayiotis Smeros, et al.

This paper describes, develops, and validates SciLens, a method to evaluate the quality of scientific news articles. The starting point for our work are structured methodologies that define a series of quality aspects for manually evaluating news. Based on these aspects, we describe a series of indicators of news quality. According to our experiments, these indicators help non-experts evaluate more accurately the quality of a scientific news article, compared to non-experts that do not have access to these indicators. Furthermore, SciLens can also be used to produce a completely automated quality score for an article, which agrees more with expert evaluators than manual evaluations done by non-experts. One of the main elements of SciLens is the focus on both content and context of articles, where context is provided by (1) explicit and implicit references on the article to scientific literature, and (2) reactions in social media referencing the article. We show that both contextual elements can be valuable sources of information for determining article quality. The validation of SciLens, done through a combination of expert and non-expert annotation, demonstrates its effectiveness for both semi-automatic and automatic quality evaluation of scientific news.


SciLens News Platform: A System for Real-Time Evaluation of News Articles

We demonstrate the SciLens News Platform, a novel system for evaluating ...

SciClops: Detecting and Contextualizing Scientific Claims for Assisting Manual Fact-Checking

This paper describes SciClops, a method to help combat online scientific...

SciLander: Mapping the Scientific News Landscape

The COVID-19 pandemic has fueled the spread of misinformation on social ...

Global Contentious Politics Database (GLOCON) Annotation Manuals

The database creation utilized automated text processing tools that dete...

NewsComp: Facilitating Diverse News Reading through Comparative Annotation

To support efficient, balanced news consumption, merging articles from d...

Really? Well. Apparently Bootstrapping Improves the Performance of Sarcasm and Nastiness Classifiers for Online Dialogue

More and more of the information on the web is dialogic, from Facebook n...

Headline Diagnosis: Manipulation of Content Farm Headlines

As technology grows faster, the news spreads through social media. In or...

Please sign up or login with your details

Forgot password? Click here to reset