learn2learn: A Library for Meta-Learning Research

Meta-learning researchers face two fundamental issues in their empirical work: prototyping and reproducibility. Researchers are prone to make mistakes when prototyping new algorithms and tasks because modern meta-learning methods rely on unconventional functionalities of machine learning frameworks. In turn, reproducing existing results becomes a tedious endeavour – a situation exacerbated by the lack of standardized implementations and benchmarks. As a result, researchers spend inordinate amounts of time on implementing software rather than understanding and developing new ideas. This manuscript introduces learn2learn, a library for meta-learning research focused on solving those prototyping and reproducibility issues. learn2learn provides low-level routines common across a wide-range of meta-learning techniques (e.g. meta-descent, meta-reinforcement learning, few-shot learning), and builds standardized interfaces to algorithms and benchmarks on top of them. In releasing learn2learn under a free and open source license, we hope to foster a community around standardized software for meta-learning research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/14/2019

Torchmeta: A Meta-Learning library for PyTorch

The constant introduction of standardized benchmarks in the literature h...
research
08/30/2018

Towards Reproducible Empirical Research in Meta-Learning

Meta-learning is increasingly used to support the recommendation of mach...
research
10/15/2020

ALPaCA vs. GP-based Prior Learning: A Comparison between two Bayesian Meta-Learning Algorithms

Meta-learning or few-shot learning, has been successfully applied in a w...
research
02/22/2022

Enabling Reproducibility and Meta-learning Through a Lifelong Database of Experiments (LDE)

Artificial Intelligence (AI) development is inherently iterative and exp...
research
10/03/2019

Generalized Inner Loop Meta-Learning

Many (but not all) approaches self-qualifying as "meta-learning" in deep...
research
01/04/2023

Task Weighting in Meta-learning with Trajectory Optimisation

Developing meta-learning algorithms that are un-biased toward a subset o...
research
01/19/2023

A Meta-Learning Approach for Software Refactoring

Software refactoring is the process of changing the structure of softwar...

Please sign up or login with your details

Forgot password? Click here to reset