Crowd-Machine Collaboration for Item Screening

03/21/2018
by   Evgeny Krivosheev, et al.
0

In this paper we describe how crowd and machine classifier can be efficiently combined to screen items that satisfy a set of predicates. We show that this is a recurring problem in many domains, present machine-human (hybrid) algorithms that screen items efficiently and estimate the gain over human-only or machine-only screening in terms of performance and cost.

READ FULL TEXT

page 1

page 2

page 3

research
04/01/2019

Combining Crowd and Machines for Multi-predicate Item Screening

This paper discusses how crowd and machine classifiers can be efficientl...
research
01/21/2021

Active Hybrid Classification

Hybrid crowd-machine classifiers can achieve superior performance by com...
research
05/31/2018

CrowdRev: A platform for Crowd-based Screening of Literature Reviews

In this paper and demo we present a crowd and crowd+AI based system, cal...
research
11/11/2020

Active Learning from Crowd in Document Screening

In this paper, we explore how to efficiently combine crowdsourcing and m...
research
03/21/2018

Crowd-based Multi-Predicate Screening of Papers in Literature Reviews

Systematic literature reviews (SLRs) are one of the most common and usef...
research
09/08/2016

Ashwin: Plug-and-Play System for Machine-Human Image Annotation

We present an end-to-end machine-human image annotation system where eac...
research
08/22/2023

When Are Two Lists Better than One?: Benefits and Harms in Joint Decision-making

Historically, much of machine learning research has focused on the perfo...

Please sign up or login with your details

Forgot password? Click here to reset