Happy Are Those Who Grade without Seeing: A Multi-Task Learning Approach to Grade Essays Using Gaze Behaviour

05/25/2020
by   Sandeep Mathias, et al.
0

The gaze behaviour of a reader is helpful in solving several NLP tasks such as automatic essay grading, named entity recognition, sarcasm detection etc. However, collecting gaze behaviour from readers is costly in terms of time and money. In this paper, we propose a way to improve automatic essay grading using gaze behaviour, where the gaze features are learnt at run time using a multi-task learning framework. To demonstrate the efficacy of this multi-task learning based approach to automatic essay grading, we collect gaze behaviour for 48 essays across 4 essay sets, and learn gaze behaviour for the rest of the essays, numbering over 7000 essays. Using the learnt gaze behaviour, we can achieve a statistically significant improvement in performance over the state-of-the-art system for the essay sets where we have gaze data. We also achieve a statistically significant improvement for 4 other essay sets, numbering about 6000 essays, where we have no gaze behaviour data available. Our approach establishes that learning gaze behaviour improves automatic essay grading.

READ FULL TEXT
research
12/15/2021

Cognition-aware Cognate Detection

Automatic detection of cognates helps downstream NLP tasks of Machine Tr...
research
12/21/2021

A Survey on Using Gaze Behaviour for Natural Language Processing

Gaze behaviour has been used as a way to gather cognitive information fo...
research
07/27/2018

Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency

This paper addresses the challenging problem of estimating the general v...
research
10/11/2018

Eyes are the Windows to the Soul: Predicting the Rating of Text Quality Using Gaze Behaviour

Predicting a reader's rating of text quality is a challenging task that ...
research
04/12/2016

Improving sentence compression by learning to predict gaze

We show how eye-tracking corpora can be used to improve sentence compres...
research
10/08/2018

Guiding Intelligent Surveillance System by learning-by-synthesis gaze estimation

We describe a novel learning-by-synthesis method for estimating gaze dir...
research
01/19/2019

Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

Internal thought refers to the process of directing attention away from ...

Please sign up or login with your details

Forgot password? Click here to reset