Differential item functioning via robust scaling

07/11/2022
by   Peter F. Halpin, et al.
0

This paper proposes a new method for assessing differential item functioning (DIF) in item response theory (IRT) models. The method does not require pre-specification of anchor items, which is its main virtue. It is developed in two main steps, first by showing how DIF can be re-formulated as a problem of outlier detection in IRT-based scaling, then tackling the latter using established methods from robust statistics. The proposal is a redescending M-estimator of IRT scaling parameters that is tuned to flag items with DIF at the desired asymptotic Type I Error rate during estimation. Theoretical results guarantee that the method performs reasonably well when fewer than one-half of the items on a test exhibit DIF. Data simulations show that the proposed method compares favorably to currently available approaches, and a real data example illustrates its application in a research context where pre-specification of anchor items is infeasible. The focus of the paper is the two-parameter logistic model in two independent groups, with extensions to other settings considered in the conclusion.

READ FULL TEXT

page 18

page 19

research
05/01/2023

DIF Analysis with Unknown Groups and Anchor Items

Measurement invariance across items is key to the validity of instrument...
research
02/24/2023

Parameter estimation in generalised logistic model with application to DIF detection

This paper proposes innovations to parameter estimation in a generalised...
research
01/20/2023

Collected Notes on Aldrich-Mckelevey Scaling

Aldrich-McKelvey scaling is a method for correcting differential item fu...
research
10/21/2021

DIF Statistical Inference and Detection without Knowing Anchoring Items

Establishing the invariance property of an instrument (e.g., a questionn...
research
08/26/2023

The Spearman-Brown Formula and Reliabilities of Random Test Forms

It is shown that the psychometric test reliability, based on any true-sc...
research
05/04/2023

Adaptive Selection of Anchor Items for CUR-based k-NN search with Cross-Encoders

Cross-encoder models, which jointly encode and score a query-item pair, ...
research
04/02/2019

New ITEM response models: application to school bullying data

School bullying victimization is a variable that cannot be measured dire...

Please sign up or login with your details

Forgot password? Click here to reset