A Synthetic Prediction Market for Estimating Confidence in Published Work

12/23/2021
by   Sarah Rajtmajer, et al.
0

Explainably estimating confidence in published scholarly work offers opportunity for faster and more robust scientific progress. We develop a synthetic prediction market to assess the credibility of published claims in the social and behavioral sciences literature. We demonstrate our system and detail our findings using a collection of known replication projects. We suggest that this work lays the foundation for a research agenda that creatively uses AI for peer review.

READ FULL TEXT
research
01/31/2021

Predicting replicability – analysis of survey and prediction market data from large-scale forecasting projects

The reproducibility of published research has become an important topic ...
research
05/10/2020

Replication Markets: Results, Lessons, Challenges and Opportunities in AI Replication

The last decade saw the emergence of systematic large-scale replication ...
research
05/06/2023

Bayesian sample size determination for multi-site replication studies

An ongoing "reproducibility crisis" calls into question scientific disco...
research
10/04/2022

PreprintMatch: a tool for preprint publication detection applied to analyze global inequities in scientific publishing

Preprints, versions of scientific manuscripts that precede peer review, ...
research
03/10/2020

Asian Handicap football betting with Rating-based Hybrid Bayesian Networks

Despite the massive popularity of the Asian Handicap (AH) football betti...
research
07/21/2017

Errors and secret data in the Italian research assessment exercise. A comment to a reply

Italy adopted a performance-based system for funding universities that i...
research
02/05/2021

A Disciplinary View of Changes in Publications' Reference Lists After Peer Review

This paper provides insight into the changes manuscripts undergo during ...

Please sign up or login with your details

Forgot password? Click here to reset