A psychometric modeling approach to fuzzy rating data

02/08/2021
by   Antonio Calcagnì, et al.
0

Modeling fuzziness and imprecision in human rating data is a crucial problem in many research areas, including applied statistics, behavioral, social, and health sciences. Because of the interplay between cognitive, affective, and contextual factors, the process of answering survey questions is a complex task, which can barely be captured by standard (crisp) rating responses. Fuzzy rating scales have progressively been adopted to overcome some of the limitations of standard rating scales, including their inability to disentangle decision uncertainty from individual responses. The aim of this article is to provide a novel fuzzy scaling procedure which uses Item Response Theory trees (IRTrees) as a psychometric model for the stage-wise latent response process. In so doing, fuzziness of rating data is modeled using the overall rater's pattern of responses instead of being computed using a single-item based approach. This offers a consistent system for interpreting fuzziness in terms of individual-based decision uncertainty. A simulation study and two empirical applications are adopted to assess the characteristics of the proposed model and provide converging results about its effectiveness in modeling fuzziness and imprecision in rating data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2021

fIRTree: An Item Response Theory modeling of fuzzy rating data

In this contribution we describe a novel procedure to represent fuzzines...
research
01/08/2022

A probabilistic tree model to analyze fuzzy rating data

In this contribution we provide initial findings to the problem of model...
research
06/29/2020

Modeling random and non-random decision uncertainty in ratings data: A fuzzy beta model

Modeling human ratings data subject to raters' decision uncertainty is a...
research
03/09/2022

Jointly modeling rating responses and times with fuzzy numbers: An application to psychometric data

In several research areas, ratings data and response times have been suc...
research
08/04/2021

Goldilocks: Consistent Crowdsourced Scalar Annotations with Relative Uncertainty

Human ratings have become a crucial resource for training and evaluating...
research
12/05/2017

Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation

Rating scales are a widely used method for data annotation; however, the...
research
05/07/2021

Estimating latent linear correlations from fuzzy frequency tables

This research concerns the estimation of latent linear or polychoric cor...

Please sign up or login with your details

Forgot password? Click here to reset