Do we need to go Deep? Knowledge Tracing with Big Data

01/20/2021
by   Varun Mandalapu, et al.
1

Interactive Educational Systems (IES) enabled researchers to trace student knowledge in different skills and provide recommendations for a better learning path. To estimate the student knowledge and further predict their future performance, the interest in utilizing the student interaction data captured by IES to develop learner performance models is increasing rapidly. Moreover, with the advances in computing systems, the amount of data captured by these IES systems is also increasing that enables deep learning models to compete with traditional logistic models and Markov processes. However, it is still not empirically evident if these deep models outperform traditional models on the current scale of datasets with millions of student interactions. In this work, we adopt EdNet, the largest student interaction dataset publicly available in the education domain, to understand how accurately both deep and traditional models predict future student performances. Our work observes that logistic regression models with carefully engineered features outperformed deep models from extensive experimentation. We follow this analysis with interpretation studies based on Locally Interpretable Model-agnostic Explanation (LIME) to understand the impact of various features on best performing model pre-dictions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2021

An Empirical Comparison of Deep Learning Models for Knowledge Tracing on Large-Scale Dataset

Knowledge tracing (KT) is the problem of modeling each student's mastery...
research
05/02/2020

Generalized Knowledge Tracing: A Constrained Framework for Learner Modeling

Adaptive learning technology solutions often use a learner model to trac...
research
12/22/2020

BKT-LSTM: Efficient Student Modeling for knowledge tracing and student performance prediction

Recently, we have seen a rapid rise in usage of online educational platf...
research
04/08/2016

Back to the Basics: Bayesian extensions of IRT outperform neural networks for proficiency estimation

Estimating student proficiency is an important task for computer based l...
research
12/06/2019

EdNet: A Large-Scale Hierarchical Dataset in Education

With advances in Artificial Intelligence in Education (AIEd) and the eve...
research
01/01/2020

Assessment Modeling: Fundamental Pre-training Tasks for Interactive Educational Systems

Interactive Educational Systems (IESs) have developed rapidly in recent ...
research
05/03/2018

Data-Driven Exploration of Factors Affecting Federal Student Loan Repayment

Student loans occupy a significant portion of the federal budget, as wel...

Please sign up or login with your details

Forgot password? Click here to reset