Mastering Rate based Curriculum Learning

08/14/2020
by   Lucas Willems, et al.
1

Recent automatic curriculum learning algorithms, and in particular Teacher-Student algorithms, rely on the notion of learning progress, making the assumption that the good next tasks are the ones on which the learner is making the fastest progress or digress. In this work, we first propose a simpler and improved version of these algorithms. We then argue that the notion of learning progress itself has several shortcomings that lead to a low sample efficiency for the learner. We finally propose a new algorithm, based on the notion of mastering rate, that significantly outperforms learning progress-based algorithms.

READ FULL TEXT

page 11

page 12

page 13

research
07/01/2017

Teacher-Student Curriculum Learning

We propose Teacher-Student Curriculum Learning (TSCL), a framework for a...
research
10/16/2019

Teacher algorithms for curriculum learning of Deep RL in continuously parameterized environments

We consider the problem of how a teacher algorithm can enable an unknown...
research
02/07/2023

Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learning

Recent advances in multi-agent reinforcement learning (MARL) allow agent...
research
12/28/2020

Automatic Curriculum Learning With Over-repetition Penalty for Dialogue Policy Learning

Dialogue policy learning based on reinforcement learning is difficult to...
research
06/08/2021

Curriculum Design for Teaching via Demonstrations: Theory and Applications

We consider the problem of teaching via demonstrations in sequential dec...
research
02/20/2019

Tug the Student to Learn Right: Progressive Gradient Correcting by Meta-learner on Corrupted Labels

While deep networks have strong fitting capability to complex input patt...
research
04/10/2017

Automated Curriculum Learning for Neural Networks

We introduce a method for automatically selecting the path, or syllabus,...

Please sign up or login with your details

Forgot password? Click here to reset