CrowdRev: A platform for Crowd-based Screening of Literature Reviews

05/31/2018
by   Jorge Ramirez, et al.
0

In this paper and demo we present a crowd and crowd+AI based system, called CrowdRev, supporting the screening phase of literature reviews and achieving the same quality as author classification at a fraction of the cost, and near-instantly. CrowdRev makes it easy for authors to leverage the crowd, and ensures that no money is wasted even in the face of difficult papers or criteria: if the system detects that the task is too hard for the crowd, it just gives up trying (for that paper, or for that criteria, or altogether), without wasting money and never compromising on quality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2018

Crowd-based Multi-Predicate Screening of Papers in Literature Reviews

Systematic literature reviews (SLRs) are one of the most common and usef...
research
03/21/2018

Crowd-Machine Collaboration for Item Screening

In this paper we describe how crowd and machine classifier can be effici...
research
04/01/2019

Combining Crowd and Machines for Multi-predicate Item Screening

This paper discusses how crowd and machine classifiers can be efficientl...
research
09/15/2017

Crowdsourcing Paper Screening in Systematic Literature Reviews

Literature reviews allow scientists to stand on the shoulders of giants,...
research
05/01/2023

Automated Paper Screening for Clinical Reviews Using Large Language Models

Objective: To assess the performance of the OpenAI GPT API in accurately...
research
08/11/2021

Researcher or Crowd Member? Why not both! The Open Research Knowledge Graph for Applying and Communicating CrowdRE Research

In recent decades, there has been a major shift towards improved digital...
research
01/08/2018

Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time

Crowd-powered conversational assistants have been shown to be more robus...

Please sign up or login with your details

Forgot password? Click here to reset