Demographic Biases of Crowd Workers in Key Opinion Leaders Finding

10/18/2021
by   Hossein A. Rahmani, et al.
0

Key Opinion Leaders (KOLs) are people that have a strong influence and their opinions are listened to by people when making important decisions. Crowdsourcing provides an efficient and cost-effective means to gather data for the KOL finding task. However, data collected through crowdsourcing is affected by the inherent demographic biases of crowd workers. To avoid such demographic biases, we need to measure how biased each crowd worker is. In this paper, we propose a simple yet effective approach based on demographic information of candidate KOLs and their counterfactual value. We argue that it is effectiveness because of the extra information that we can consider together with labeled data to curate a less biased dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2020

Measuring Social Biases of Crowd Workers using Counterfactual Queries

Social biases based on gender, race, etc. have been shown to pollute mac...
research
05/01/2020

Towards Controllable Biases in Language Generation

We present a general approach towards controllable societal biases in na...
research
09/16/2020

Human biases in body measurement estimation

Body measurements, including weight and height, are key indicators of he...
research
12/23/2015

Selecting the top-quality item through crowd scoring

We investigate crowdsourcing algorithms for finding the top-quality item...
research
04/25/2023

Fairness and Bias in Truth Discovery Algorithms: An Experimental Analysis

Machine learning (ML) based approaches are increasingly being used in a ...
research
09/06/2019

CrowdHub: Extending crowdsourcing platforms for the controlled evaluation of tasks designs

We present CrowdHub, a tool for running systematic evaluations of task d...
research
12/14/2018

Characterizing the Global Crowd Workforce: A Cross-Country Comparison of Crowdworker Demographics

Micro-task crowdsourcing is an international phenomenon that has emerged...

Please sign up or login with your details

Forgot password? Click here to reset