Curriculum Learning: A Survey

01/25/2021
by   Petru Soviany, et al.
0

Training machine learning models in a meaningful order, from the easy samples to the hard ones, using curriculum learning can provide performance improvements over the standard training approach based on random data shuffling, without any additional computational costs. Curriculum learning strategies have been successfully employed in all areas of machine learning, in a wide range of tasks. However, the necessity of finding a way to rank the samples from easy to hard, as well as the right pacing function for introducing more difficult data can limit the usage of the curriculum approaches. In this survey, we show how these limits have been tackled in the literature, and we present different curriculum learning instantiations for various tasks in machine learning. We construct a multi-perspective taxonomy of curriculum learning approaches by hand, considering various classification criteria. We further build a hierarchical tree of curriculum learning methods using an agglomerative clustering algorithm, linking the discovered clusters with our taxonomy. At the end, we provide some interesting directions for future work.

READ FULL TEXT
research
02/06/2023

Curriculum Graph Machine Learning: A Survey

Graph machine learning has been extensively studied in both academia and...
research
10/25/2020

A Comprehensive Survey on Curriculum Learning

Curriculum learning (CL) is a training strategy that trains a machine le...
research
07/14/2023

HuCurl: Human-induced Curriculum Discovery

We introduce the problem of curriculum discovery and describe a curricul...
research
11/21/2022

In-sample Curriculum Learning by Sequence Completion for Natural Language Generation

Curriculum learning has shown promising improvements in multiple domains...
research
05/21/2018

Understanding Self-Paced Learning under Concave Conjugacy Theory

By simulating the easy-to-hard learning manners of humans/animals, the l...
research
11/28/2022

Easy Begun is Half Done: Spatial-Temporal Graph Modeling with ST-Curriculum Dropout

Spatial-temporal (ST) graph modeling, such as traffic speed forecasting ...
research
08/23/2023

Curriculum Learning with Adam: The Devil Is in the Wrong Details

Curriculum learning (CL) posits that machine learning models – similar t...

Please sign up or login with your details

Forgot password? Click here to reset