DeepAI AI Chat
Log In Sign Up

Process-BERT: A Framework for Representation Learning on Educational Process Data

by   Alexander Scarlatos, et al.
University of Massachusetts Amherst
Purdue University

Educational process data, i.e., logs of detailed student activities in computerized or online learning platforms, has the potential to offer deep insights into how students learn. One can use process data for many downstream tasks such as learning outcome prediction and automatically delivering personalized intervention. However, analyzing process data is challenging since the specific format of process data varies a lot depending on different learning/testing scenarios. In this paper, we propose a framework for learning representations of educational process data that is applicable across many different learning scenarios. Our framework consists of a pre-training step that uses BERT-type objectives to learn representations from sequential process data and a fine-tuning step that further adjusts these representations on downstream prediction tasks. We apply our framework to the 2019 nation's report card data mining competition dataset that consists of student problem-solving process data and detail the specific models we use in this scenario. We conduct both quantitative and qualitative experiments to show that our framework results in process data representations that are both predictive and informative.


page 1

page 2

page 3

page 4


Improving Knowledge Graph Representation Learning by Structure Contextual Pre-training

Representation learning models for Knowledge Graphs (KG) have proven to ...

Visualizing and Understanding the Effectiveness of BERT

Language model pre-training, such as BERT, has achieved remarkable resul...

RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Training

With the growth of the academic engines, the mining and analysis acquisi...

Incorporating Features Learned by an Enhanced Deep Knowledge Tracing Model for STEM/Non-STEM Job Prediction

The 2017 ASSISTments Data Mining competition aims to use data from a lon...

Assessment Modeling: Fundamental Pre-training Tasks for Interactive Educational Systems

Interactive Educational Systems (IESs) have developed rapidly in recent ...

Towards a General Pre-training Framework for Adaptive Learning in MOOCs

Adaptive learning aims to stimulate and meet the needs of individual lea...

Wide Deep Learning for Judging Student Performance in Online One-on-one Math Classes

In this paper, we investigate the opportunities of automating the judgme...

Code Repositories


The associated code for the paper "Process-BERT: A Framework for Representation Learning on Educational Process Data".

view repo