Hypothesis Testing for Hierarchical Structures in Cognitive Diagnosis Models

by   Chenchen Ma, et al.

Cognitive Diagnosis Models (CDMs) are a special family of discrete latent variable models widely used in educational, psychological and social sciences. In many applications of CDMs, certain hierarchical structures among the latent attributes are assumed by researchers to characterize their dependence structure. Specifically, a directed acyclic graph is used to specify hierarchical constraints on the allowable configurations of the discrete latent attributes. In this paper, we consider the important yet unaddressed problem of testing the existence of latent hierarchical structures in CDMs. We first introduce the concept of testability of hierarchical structures in CDMs and present sufficient conditions. Then we study the asymptotic behaviors of the likelihood ratio test (LRT) statistic, which is widely used for testing nested models. Due to the irregularity of the problem, the asymptotic distribution of LRT becomes nonstandard and tends to provide unsatisfactory finite sample performance under practical conditions. We provide statistical insights on such failures, and propose to use parametric bootstrap to perform the testing. We also demonstrate the effectiveness and superiority of parametric bootstrap for testing the latent hierarchies over non-parametric bootstrap and the naïve Chi-squared test through comprehensive simulations and an educational assessment dataset.



There are no comments yet.


page 1

page 2

page 3

page 4


Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models

Cognitive Diagnosis Models (CDMs) are a special family of discrete laten...

Identification and Estimation of Hierarchical Latent Attribute Models

Hierarchical Latent Attribute Models (HLAMs) are a popular family of dis...

Robust Hypothesis Testing and Model Selection for Parametric Proportional Hazard Regression Models

The semi-parametric Cox proportional hazards regression model has been w...

A Joint MLE Approach to Large-Scale Structured Latent Attribute Analysis

Structured Latent Attribute Models (SLAMs) are a family of discrete late...

Learning Attribute Patterns in High-Dimensional Structured Latent Attribute Models

Structured latent attribute models (SLAMs) are a special family of discr...

Asymptotics for Markov chain mixture detection

Sufficient conditions are provided under which the log-likelihood ratio ...

Multivariate ordered discrete response models

We introduce multivariate ordered discrete response models that exhibit ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.