Automated Essay Scoring based on Two-Stage Learning

01/23/2019
by   Jiawei Liu, et al.
0

Current state-of-art feature-engineered and end-to-end Automated Essay Score (AES) methods are proven to be unable to detect adversarial samples, e.g. the essays composed of permuted sentences and the prompt-irrelevant essays. Focusing on the problem, we develop a Two-Stage Learning Framework (TSLF) which integrates the advantages of both feature-engineered and end-to-end AES models. In experiments, we compare TSLF against a number of strong baselines, and the results demonstrate the effectiveness and robustness of our models. TSLF surpasses all the baselines on five-eighths of prompts and achieves new state-of-the-art average performance when without negative samples. After adding some adversarial essays to the original datasets, TSLF outperforms the feature-engineered and end-to-end baselines to a great extent, and shows great robustness.

READ FULL TEXT
research
04/18/2018

Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Input

We demonstrate that current state-of-the-art approaches to Automated Ess...
research
09/18/2023

EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning

When translating UI design prototypes to code in industry, automatically...
research
06/25/2023

Addressing Cold Start Problem for End-to-end Automatic Speech Scoring

Integrating automatic speech scoring/assessment systems has become a cri...
research
09/24/2018

Speaker Naming in Movies

We propose a new model for speaker naming in movies that leverages visua...
research
07/15/2020

End-to-end training of a two-stage neural network for defect detection

Segmentation-based, two-stage neural network has shown excellent results...
research
08/29/2018

Neural Metaphor Detection in Context

We present end-to-end neural models for detecting metaphorical word use ...
research
09/24/2021

AES Systems Are Both Overstable And Oversensitive: Explaining Why And Proposing Defenses

Deep-learning based Automatic Essay Scoring (AES) systems are being acti...

Please sign up or login with your details

Forgot password? Click here to reset