Consistency and Monotonicity Regularization for Neural Knowledge Tracing

05/03/2021
by   Seewoo Lee, et al.
0

Knowledge Tracing (KT), tracking a human's knowledge acquisition, is a central component in online learning and AI in Education. In this paper, we present a simple, yet effective strategy to improve the generalization ability of KT models: we propose three types of novel data augmentation, coined replacement, insertion, and deletion, along with corresponding regularization losses that impose certain consistency or monotonicity biases on the model's predictions for the original and augmented sequence. Extensive experiments on various KT benchmarks show that our regularization scheme consistently improves the model performances, under 3 widely-used neural networks and 4 public benchmarks, e.g., it yields 6.3 ASSISTmentsChall dataset.

READ FULL TEXT
research
05/25/2022

Augmentation-induced Consistency Regularization for Classification

Deep neural networks have become popular in many supervised learning tas...
research
06/06/2018

Addressing Two Problems in Deep Knowledge Tracing via Prediction-Consistent Regularization

Knowledge tracing is one of the key research areas for empowering person...
research
02/24/2022

Sample Efficiency of Data Augmentation Consistency Regularization

Data augmentation is popular in the training of large neural networks; c...
research
03/22/2022

A New Approach to Improve Learning-based Deepfake Detection in Realistic Conditions

Deep convolutional neural networks have achieved exceptional results on ...
research
06/06/2020

MMA Regularization: Decorrelating Weights of Neural Networks by Maximizing the Minimal Angles

The strong correlation between neurons or filters can significantly weak...
research
01/07/2022

Semantic-based Data Augmentation for Math Word Problems

It's hard for neural MWP solvers to deal with tiny local variances. In M...
research
08/20/2023

Towards Generalizable Morph Attack Detection with Consistency Regularization

Though recent studies have made significant progress in morph attack det...

Please sign up or login with your details

Forgot password? Click here to reset