Automatic Classification of Error Types in Solutions to Programming Assignments at Online Learning Platform

07/13/2021
by   Artyom Lobanov, et al.
0

Online programming courses are becoming more and more popular, but they still have significant drawbacks when compared to the traditional education system, e.g., the lack of feedback. In this study, we apply machine learning methods to improve the feedback of automated verification systems for programming assignments. We propose an approach that provides an insight on how to fix the code for a given incorrect submission. To achieve this, we detect frequent error types by clustering previously submitted incorrect solutions, label these clusters and use this labeled dataset to identify the type of an error in a new submission. We examine and compare several approaches to the detection of frequent error types and to the assignment of clusters to new submissions. The proposed method is evaluated on a dataset provided by a popular online learning platform.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2012

Automated Feedback Generation for Introductory Programming Assignments

We present a new method for automatically providing feedback for introdu...
research
08/12/2017

TraceDiff: Debugging Unexpected Code Behavior Using Trace Divergences

Recent advances in program synthesis offer means to automatically debug ...
research
09/05/2018

Zero Shot Learning for Code Education: Rubric Sampling with Deep Learning Inference

In modern computer science education, massive open online courses (MOOCs...
research
06/03/2022

Automated Feedback Generation for Competition-Level Code

Competitive programming has become a popular way for programmers to test...
research
03/24/2021

Discovering Multiple Design Approaches in Programming Assignment Submissions

In this paper, we present a novel approach of automated evaluation of pr...
research
02/10/2021

Characterizing the Online Learning Landscape: What and How People Learn Online

Hundreds of millions of people learn something new online every day. Sim...
research
08/19/2020

Assessing the Effectiveness of Using Live Interactions and Feedback to Increase Engagement in Online Learning

In-person instruction for professional development or other types of wor...

Please sign up or login with your details

Forgot password? Click here to reset