Multi-task Learning for Low-resource Second Language Acquisition Modeling

08/25/2019
by   Yong Hu, et al.
0

Second language acquisition (SLA) modeling is to predict whether second language learners could correctly answer the questions according to what they have learned. It is a fundamental building block of the personalized learning system and has attracted more and more attention recently. However, as far as we know, almost all existing methods cannot work well in low-resource scenarios because lacking of training data. Fortunately, there are some latent common patterns among different language-learning tasks, which gives us an opportunity to solve the low-resource SLA modeling problem. Inspired by this idea, in this paper, we propose a novel SLA modeling method, which learns the latent common patterns among different language-learning datasets by multi-task learning and are further applied to improving the prediction performance in low-resource scenarios. Extensive experiments show that the proposed method performs much better than the state-of-the-art baselines in the low-resource scenario. Meanwhile, it also obtains improvement slightly in the non-low-resource scenario.

READ FULL TEXT

page 1

page 7

research
04/11/2018

Multi-Task Learning for Argumentation Mining in Low-Resource Settings

We investigate whether and where multi-task learning (MTL) can improve p...
research
05/01/2020

Low Resource Multi-Task Sequence Tagging – Revisiting Dynamic Conditional Random Fields

We compare different models for low resource multi-task sequence tagging...
research
08/27/2019

Investigating Meta-Learning Algorithms for Low-Resource Natural Language Understanding Tasks

Learning general representations of text is a fundamental problem for ma...
research
10/10/2020

Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments

Although the prediction of dialects is an important language processing ...
research
08/28/2018

Deriving Machine Attention from Human Rationales

Attention-based models are successful when trained on large amounts of d...
research
12/15/2017

A Novel Approach for Effective Learning in Low Resourced Scenarios

Deep learning based discriminative methods, being the state-of-the-art m...
research
12/07/2019

Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities

In this paper, we examine and analyze the challenges associated with dev...

Please sign up or login with your details

Forgot password? Click here to reset