Report-Sensitive Spot-Checking in Peer-Grading Systems

06/13/2019
by   Hedayat Zarkoob, et al.
0

Peer grading systems make large courses more scalable, provide students with faster and more detailed feedback, and help students to learn by thinking critically about the work of others. A key obstacle to the broader adoption of peer grading is motivating students to provide accurate grades. To incentivize accurate grading, previous work has considered mechanisms that spot-check each submission (i.e., randomly compare it to a TA grade) with a fixed probability. In this work, we introduce a mechanism that spot checks students in a way that depends on the grades they report, providing the same incentives at lower costs than the fixed-probability mechanism. We also show, surprisingly, that TA workload is reduced by choosing not to spot check some students even when TA assessments are available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/13/2020

Development of a Web Platform for Code Peer-Testing

As part of formative and summative assessments in programming courses, s...
research
01/18/2021

Mechanical TA 2: A System for Peer Grading with TA Support

Mechanical TA 2 (MTA2) is an open source web-based peer grading applicat...
research
09/02/2022

Better Peer Grading through Bayesian Inference

Peer grading systems aggregate noisy reports from multiple students to a...
research
06/02/2015

Peer Grading in a Course on Algorithms and Data Structures: Machine Learning Algorithms do not Improve over Simple Baselines

Peer grading is the process of students reviewing each others' work, suc...
research
10/27/2019

Fostering Peer Learning through a New Game-Theoretical Approach in a Blended Learning Environment

Obtaining knowledge and skill achievement through peer learning can lead...
research
07/17/2022

Review of Advanced Monitoring Mechanisms in Peer-to-Peer (P2P) Botnets

Internet security is getting less secure because of the existing of botn...
research
02/25/2016

How effective can simple ordinal peer grading be?

Ordinal peer grading has been proposed as a simple and scalable solution...

Please sign up or login with your details

Forgot password? Click here to reset