SnapCheck: Automated Testing for Snap Programs

04/23/2021
by   Wengran Wang, et al.
0

Programming environments such as Snap, Scratch, and Processing engage learners by allowing them to create programming artifacts such as apps and games, with visual and interactive output. Learning programming with such a media-focused context has been shown to increase retention and success rate. However, assessing these visual, interactive projects requires time and laborious manual effort, and it is therefore difficult to offer automated or real-time feedback to students as they work. In this paper, we introduce SnapCheck, a dynamic testing framework for Snap that enables instructors to author test cases with Condition-Action templates. The goal of SnapCheck is to allow instructors or researchers to author property-based test cases that can automatically assess students' interactive programs with high accuracy. Our evaluation of SnapCheck on 162 code snapshots from a Pong game assignment in an introductory programming course shows that our automated testing framework achieves at least 98 SnapCheck for auto-grading and providing formative feedback to students.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2021

How do students test software units?

We gained insight into ideas and beliefs on testing of students who fini...
research
02/12/2021

Gradeer: An Open-Source Modular Hybrid Grader

Automated assessment has been shown to greatly simplify the process of a...
research
04/19/2022

ITSS: Interactive Web-Based Authoring and Playback Integrated Environment for Programming Tutorials

Video-based programming tutorials are a popular form of tutorial used by...
research
04/10/2020

In the Eye of the Beholder? Detecting Creativity in Visual Programming Environments

Visual programming environments are increasingly part of the curriculum ...
research
06/21/2019

Investigating the Essential of Meaningful Automated Formative Feedback for Programming Assignments

This study investigated the essential of meaningful automated feedback f...
research
05/12/2021

Guiding Next-Step Hint Generation Using Automated Tests

Learning basic programming with Scratch can be hard for novices and tuto...
research
10/21/2021

Towards Automatic Grading of D3.js Visualizations

Manually grading D3 data visualizations is a challenging endeavor, and i...

Please sign up or login with your details

Forgot password? Click here to reset