ALPaCA vs. GP-based Prior Learning: A Comparison between two Bayesian Meta-Learning Algorithms

10/15/2020
by   Yilun Wu, et al.
0

Meta-learning or few-shot learning, has been successfully applied in a wide range of domains from computer vision to reinforcement learning. Among the many frameworks proposed for meta-learning, bayesian methods are particularly favoured when accurate and calibrated uncertainty estimate is required. In this paper, we investigate the similarities and disparities among two recently published bayesian meta-learning methods: ALPaCA (Harrison et al. [2018]) and PACOH (Rothfuss et al. [2020]). We provide theoretical analysis as well as empirical benchmarks across synthetic and real-world dataset. While ALPaCA holds advantage in computation time by the usage of a linear kernel, general GP-based methods provide much more flexibility and achieves better result across datasets when using a common kernel such as SE (Squared Exponential) kernel. The influence of different loss function choice is also discussed.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 10

08/27/2020

learn2learn: A Library for Meta-Learning Research

Meta-learning researchers face two fundamental issues in their empirical...
10/08/2021

Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning

In few-shot learning scenarios, the challenge is to generalize and perfo...
10/25/2021

Multi-Task Meta-Learning Modification with Stochastic Approximation

Meta-learning methods aim to build learning algorithms capable of quickl...
01/18/2021

Robustness of Meta Matrix Factorization Against Strict Privacy Constraints

In this paper, we explore the reproducibility of MetaMF, a meta matrix f...
10/21/2021

Bayesian Meta-Learning Through Variational Gaussian Processes

Recent advances in the field of meta-learning have tackled domains consi...
07/24/2018

Meta-Learning Priors for Efficient Online Bayesian Regression

Gaussian Process (GP) regression has seen widespread use in robotics due...
05/25/2018

Analysing Symbolic Regression Benchmarks under a Meta-Learning Approach

The definition of a concise and effective testbed for Genetic Programmin...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.