The Achievement of Higher Flexibility in Multiple Choice-based Tests Using Image Classification Techniques

11/02/2017
by   Mahmoud Afifi, et al.
0

In spite of the high accuracy of the existing optical mark reading (OMR) systems and devices, a few restrictions remain existent. In this work, we aim to reduce the restrictions of multiple choice questions (MCQ) within tests. We use an image registration technique to extract the answer boxes from the answer sheets. Unlike other systems that rely on simple image processing steps to recognize the extracted answer boxes, we address the problem from another perspective by training a classifier to recognize the class of each answer box (i.e. confirmed, crossed out, and blank answer). This gives us the ability to deal with a variety of shading and mark patterns, and distinguish between chosen and canceled answers. All existing machine learning techniques require a large number of examples in order to train the classifier, therefore we present a dataset that consists of five real MCQ tests and a quiz that have different answer sheet templates. We evaluate two strategies of classification: a straight-forward approach and a two-stage classifier approach. We test two handcrafted feature methods and a convolutional neural network. At the end, we present an easy-to-use graphical user interface of the proposed system. Compared with existing OMR systems, the proposed system is considered of a higher accuracy and the least constraints. We believe that the presented work will further direct the development of OMR systems towards template-free MCQ tests without restrictions.

READ FULL TEXT
research
07/03/2023

Analyzing Multiple-Choice Reading and Listening Comprehension Tests

Multiple-choice reading and listening comprehension tests are an importa...
research
11/06/2020

Answer Span Correction in Machine Reading Comprehension

Answer validation in machine reading comprehension (MRC) consists of ver...
research
12/10/2020

Bew: Towards Answering Business-Entity-Related Web Questions

We present BewQA, a system specifically designed to answer a class of qu...
research
06/10/2019

BAGS: An automatic homework grading system using the pictures taken by smart phones

Homework grading is critical to evaluate teaching quality and effect. Ho...
research
11/01/2020

Generating Correct Answers for Progressive Matrices Intelligence Tests

Raven's Progressive Matrices are multiple-choice intelligence tests, whe...
research
03/28/2018

How to ask sensitive multiple choice questions

Motivated by recent failures of polling to estimate populist party suppo...
research
05/19/2011

A Multiple-Choice Test Recognition System based on the Gamera Framework

This article describes JECT-OMR, a system that analyzes digital images r...

Please sign up or login with your details

Forgot password? Click here to reset