Meta Learning for Natural Language Processing: A Survey

05/03/2022
by   Hung-Yi Lee, et al.
0

Deep learning has been the mainstream technique in natural language processing (NLP) area. However, the techniques require many labeled data and are less generalizable across domains. Meta-learning is an arising field in machine learning studying approaches to learn better learning algorithms. Approaches aim at improving algorithms in various aspects, including data efficiency and generalizability. Efficacy of approaches has been shown in many NLP tasks, but there is no systematic survey of these approaches in NLP, which hinders more researchers from joining the field. Our goal with this survey paper is to offer researchers pointers to relevant meta-learning works in NLP and attract more attention from the NLP community to drive future innovation. This paper first introduces the general concepts of meta-learning and the common approaches. Then we summarize task construction settings and application of meta-learning for various NLP problems and review the development of meta-learning in NLP community.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2020

Meta-learning for Few-shot Natural Language Processing: A Survey

Few-shot natural language processing (NLP) refers to NLP tasks that are ...
research
08/26/2022

What Do NLP Researchers Believe? Results of the NLP Community Metasurvey

We present the results of the NLP Community Metasurvey. Run from May to ...
research
11/03/2020

Meta-Learning for Natural Language Understanding under Continual Learning Framework

Neural network has been recognized with its accomplishments on tackling ...
research
04/17/2023

Thorny Roses: Investigating the Dual Use Dilemma in Natural Language Processing

Dual use, the intentional, harmful reuse of technology and scientific ar...
research
04/23/2020

Towards an evolutionary-based approach for natural language processing

Tasks related to Natural Language Processing (NLP) have recently been th...
research
03/13/2022

A Systematic Study and Analysis of Bengali Folklore with Natural Language Processing Systems

Folklore, a solid branch of folk literature, is the hallmark of any nati...
research
01/04/2023

MessageNet: Message Classification using Natural Language Processing and Meta-data

In this paper we propose a new Deep Learning (DL) approach for message c...

Please sign up or login with your details

Forgot password? Click here to reset