Bayesian item response models for citizen science ecological data

03/16/2020
by   Edgar Santos-Fernández, et al.
0

So-called citizen science data elicited from crowds has become increasingly popular in many fields including ecology. However, the quality of this information is being fiercely debated by many within the scientific community. Therefore, modern citizen science implementations require measures of the users' proficiency that account for the difficulty of the tasks. We introduce a new methodological framework of item response and linear logistic test models with application to citizen science data used in ecology research. A specific feature of this approach is that spatial autocorrelation is accommodated within the item difficulties. The models produce relevant ecological measures of species and site-related difficulties, discriminatory power and guessing behavior. These, along with estimates of the subject abilities allow better management of these programs. We found that the suggested methods outperform the traditional item response models in terms of RMSE, accuracy, and WAIC based on leave-one-out cross-validation on simulated and empirical data. The fit of item response models to big data via divide-and-conquer is also discussed. We illustrate the implementation using a case study of species identification in the Serengeti, Tanzania. The main R and Stan codes are provided in the supplementary materials section, which allows the reproducibility and extrapolation to other settings.

READ FULL TEXT

page 11

page 15

page 21

research
03/10/2019

β^3-IRT: A New Item Response Model and its Applications

Item Response Theory (IRT) aims to assess latent abilities of respondent...
research
05/23/2019

Bayesian Item Response Modelling in R with brms and Stan

Item Response Theory (IRT) is widely applied in the human sciences to mo...
research
05/02/2023

Increasing trust in new data sources: crowdsourcing image classification for ecology

Crowdsourcing methods facilitate the production of scientific informatio...
research
10/03/2020

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over maximum marginal likelihood

Item response theory (IRT) is the statistical paradigm underlying a domi...
research
08/26/2021

Modeling Item Response Theory with Stochastic Variational Inference

Item Response Theory (IRT) is a ubiquitous model for understanding human...
research
06/22/2021

Face Identification Proficiency Test Designed Using Item Response Theory

Measures of face identification proficiency are essential to ensure accu...

Please sign up or login with your details

Forgot password? Click here to reset