ALPaCA vs. GP-based Prior Learning: A Comparison between two Bayesian Meta-Learning Algorithms

10/15/2020
by   Yilun Wu, et al.
0

Meta-learning or few-shot learning, has been successfully applied in a wide range of domains from computer vision to reinforcement learning. Among the many frameworks proposed for meta-learning, bayesian methods are particularly favoured when accurate and calibrated uncertainty estimate is required. In this paper, we investigate the similarities and disparities among two recently published bayesian meta-learning methods: ALPaCA (Harrison et al. [2018]) and PACOH (Rothfuss et al. [2020]). We provide theoretical analysis as well as empirical benchmarks across synthetic and real-world dataset. While ALPaCA holds advantage in computation time by the usage of a linear kernel, general GP-based methods provide much more flexibility and achieves better result across datasets when using a common kernel such as SE (Squared Exponential) kernel. The influence of different loss function choice is also discussed.

READ FULL TEXT
research
08/27/2020

learn2learn: A Library for Meta-Learning Research

Meta-learning researchers face two fundamental issues in their empirical...
research
03/06/2022

Is Bayesian Model-Agnostic Meta Learning Better than Model-Agnostic Meta Learning, Provably?

Meta learning aims at learning a model that can quickly adapt to unseen ...
research
10/25/2021

Multi-Task Meta-Learning Modification with Stochastic Approximation

Meta-learning methods aim to build learning algorithms capable of quickl...
research
04/26/2022

Meta-free few-shot learning via representation learning with weight averaging

Recent studies on few-shot classification using transfer learning pose c...
research
01/18/2021

Robustness of Meta Matrix Factorization Against Strict Privacy Constraints

In this paper, we explore the reproducibility of MetaMF, a meta matrix f...
research
12/03/2022

Meta Learning for Few-Shot Medical Text Classification

Medical professionals frequently work in a data constrained setting to p...
research
07/24/2018

Meta-Learning Priors for Efficient Online Bayesian Regression

Gaussian Process (GP) regression has seen widespread use in robotics due...

Please sign up or login with your details

Forgot password? Click here to reset