Monotonicity in practice of adaptive testing

09/15/2020
by   Martin Plajner, et al.
0

In our previous work we have shown how Bayesian networks can be used for adaptive testing of student skills. Later, we have taken the advantage of monotonicity restrictions in order to learn models fitting data better. This article provides a synergy between these two phases as it evaluates Bayesian network models used for computerized adaptive testing and learned with a recently proposed monotonicity gradient algorithm. This learning method is compared with another monotone method, the isotonic regression EM algorithm. The quality of methods is empirically evaluated on a large data set of the Czech National Mathematics Exam. Besides advantages of adaptive testing approach we observed also advantageous behavior of monotonic methods, especially for small learning data set sizes. Another novelty of this work is the use of the reliability interval of the score distribution, which is used to predict student's final score and grade. In the experiments we have clearly shown we can shorten the test while keeping its reliability. We have also shown that the monotonicity increases the prediction quality with limited training data sets. The monotone model learned by the gradient method has a lower question prediction quality than unrestricted models but it is better in the main target of this application, which is the student score prediction. It is an important observation that a mere optimization of the model likelihood or the prediction accuracy do not necessarily lead to a model that describes best the student.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2021

BOBCAT: Bilevel Optimization-Based Computerized Adaptive Testing

Computerized adaptive testing (CAT) refers to a form of tests that are p...
research
11/26/2015

Bayesian Network Models for Adaptive Testing

Computerized adaptive testing (CAT) is an interesting and promising appr...
research
04/08/2016

Back to the Basics: Bayesian extensions of IRT outperform neural networks for proficiency estimation

Estimating student proficiency is an important task for computer based l...
research
05/25/2021

A New Score for Adaptive Tests in Bayesian and Credal Networks

A test is adaptive when its sequence and number of questions is dynamica...
research
04/21/2020

Student-at-risk detection by current learning performance indicators using Bayesian networks

The present article is focused on the problem of prediction of student f...
research
02/23/2022

Single Gaussian Process Method for Arbitrary Tokamak Regimes with a Statistical Analysis

Gaussian Process Regression (GPR) is a Bayesian method for inferring pro...

Please sign up or login with your details

Forgot password? Click here to reset