Auxiliary Objectives for Neural Error Detection Models

07/17/2017
by   Marek Rei, et al.
0

We investigate the utility of different auxiliary objectives and training strategies within a neural sequence labeling approach to error detection in learner writing. Auxiliary costs provide the model with additional linguistic information, allowing it to learn general-purpose compositional features that can then be exploited for other objectives. Our experiments show that a joint learning approach trained with parallel labels on in-domain data improves performance over the previous best error detection system. While the resulting model has the same number of parameters, the additional objectives allow it to be optimised more efficiently and achieve better performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2016

Compositional Sequence Labeling Models for Error Detection in Learner Writing

In this paper, we present the first experiments using neural network mod...
research
11/30/2022

Auxiliary Learning as a step towards Artificial General Intelligence

Auxiliary Learning is a machine learning approach in which the model ack...
research
05/27/2022

AANG: Automating Auxiliary Learning

When faced with data-starved or highly complex end-tasks, it is commonpl...
research
04/24/2017

Reinforcement Learning Based Dynamic Selection of Auxiliary Objectives with Preserving of the Best Found Solution

Efficiency of single-objective optimization can be improved by introduci...
research
04/24/2017

Semi-supervised Multitask Learning for Sequence Labeling

We propose a sequence labeling framework with a secondary training objec...
research
09/13/2021

GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks

A key problem in multi-task learning (MTL) research is how to select hig...
research
02/04/2021

FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning

Federated Distillation (FD) is a popular novel algorithmic paradigm for ...

Please sign up or login with your details

Forgot password? Click here to reset