Face Identification Proficiency Test Designed Using Item Response Theory

06/22/2021
by   Géraldine Jeckeln, et al.
0

Measures of face identification proficiency are essential to ensure accurate and consistent performance by professional forensic face examiners and others who perform face identification tasks in applied scenarios. Current proficiency tests rely on static sets of stimulus items, and so, cannot be administered validly to the same individual multiple times. To create a proficiency test, a large number of items of "known" difficulty must be assembled. Multiple tests of equal difficulty can be constructed then using subsets of items. Here, we introduce a proficiency test, the Triad Identity Matching (TIM) test, based on stimulus difficulty measures based on Item Response Theory (IRT). Participants view face-image "triads" (N=225) (two images of one identity and one image of a different identity) and select the different identity. In Experiment 1, university students (N=197) showed wide-ranging accuracy on the TIM test. Furthermore, IRT modeling demonstrated that the TIM test produces items of various difficulty levels. In Experiment 2, IRT-based item difficulty measures were used to partition the TIM test into three equally "easy" and three equally "difficult" subsets. Simulation results indicated that the full set, as well as curated subsets, of the TIM items yielded reliable estimates of subject ability. In summary, the TIM test can provide a starting point for developing a framework that is flexible, calibrated, and adaptive to measure proficiency across various ability levels (e.g., professionals or populations with face processing deficits)

READ FULL TEXT

page 5

page 9

page 10

research
03/10/2019

β^3-IRT: A New Item Response Model and its Applications

Item Response Theory (IRT) aims to assess latent abilities of respondent...
research
05/28/2016

Building an Evaluation Scale using Item Response Theory

Evaluation of NLP methods requires testing against a previously vetted g...
research
04/24/2018

IRT scoring and the principle of consistent order

IRT models are being increasingly used worldwide for test construction a...
research
07/04/2016

Modeling of Item-Difficulty for Ontology-based MCQs

Multiple choice questions (MCQs) that can be generated from a domain ont...
research
08/27/2023

Adaptive Assessment of Visualization Literacy

Visualization literacy is an essential skill for accurately interpreting...
research
01/26/2019

The CATS Hackathon: Creating and Refining Test Items for Cybersecurity Concept Inventories

For two days in February 2018, 17 cybersecurity educators and profession...
research
03/16/2020

Bayesian item response models for citizen science ecological data

So-called citizen science data elicited from crowds has become increasin...

Please sign up or login with your details

Forgot password? Click here to reset