Open-Ended Knowledge Tracing

02/21/2022
by   Naiming Liu, et al.
1

Knowledge tracing refers to the problem of estimating each student's knowledge component/skill mastery level from their past responses to questions in educational applications. One direct benefit knowledge tracing methods provide is the ability to predict each student's performance on the future questions. However, one key limitation of most existing knowledge tracing methods is that they treat student responses to questions as binary-valued, i.e., whether the responses are correct or incorrect. Response correctness analysis/prediction is easy to navigate but loses important information, especially for open-ended questions: the exact student responses can potentially provide much more information about their knowledge states than only response correctness. In this paper, we present our first exploration into open-ended knowledge tracing, i.e., the analysis and prediction of students' open-ended responses to questions in the knowledge tracing setup. We first lay out a generic framework for open-ended knowledge tracing before detailing its application to the domain of computer science education with programming questions. We define a series of evaluation metrics in this domain and conduct a series of quantitative and qualitative experiments to test the boundaries of open-ended knowledge tracing methods on a real-world student code dataset.

READ FULL TEXT
research
04/19/2021

Option Tracing: Beyond Correctness Analysis in Knowledge Tracing

Knowledge tracing refers to a family of methods that estimate each stude...
research
12/16/2022

Differentiating Student Feedbacks for Knowledge Tracing

In computer-aided education and intelligent tutoring systems, knowledge ...
research
04/08/2022

No Task Left Behind: Multi-Task Learning of Knowledge Tracing and Option Tracing for Better Student Assessment

Student assessment is one of the most fundamental tasks in the field of ...
research
05/28/2018

Intelligent Knowledge Tracing: More Like a Real Learning Process of a Student

Knowledge tracing (KT) refers to a machine learning technique to assess ...
research
12/19/2021

Masked Deep Q-Recommender for Effective Question Scheduling

Providing appropriate questions according to a student's knowledge level...
research
10/14/2019

Extending Deep Knowledge Tracing: Inferring Interpretable Knowledge and Predicting Post-System Performance

Recent student knowledge modeling algorithms such as DKT and DKVMN have ...
research
12/11/2021

Programming Knowledge Tracing: A Comprehensive Dataset and A New Model

In this paper, we study knowledge tracing in the domain of programming e...

Please sign up or login with your details

Forgot password? Click here to reset