Gaussian Process Meta Few-shot Classifier Learning via Linear Discriminant Laplace Approximation

11/09/2021
by   Minyoung Kim, et al.
0

The meta learning few-shot classification is an emerging problem in machine learning that received enormous attention recently, where the goal is to learn a model that can quickly adapt to a new task with only a few labeled data. We consider the Bayesian Gaussian process (GP) approach, in which we meta-learn the GP prior, and the adaptation to a new task is carried out by the GP predictive model from the posterior inference. We adopt the Laplace posterior approximation, but to circumvent the iterative gradient steps for finding the MAP solution, we introduce a novel linear discriminant analysis (LDA) plugin as a surrogate for the MAP solution. In essence, the MAP solution is approximated by the LDA estimate, but to take the GP prior into account, we adopt the prior-norm adjustment to estimate LDA's shared variance parameters, which ensures that the adjusted estimate is consistent with the GP prior. This enables closed-form differentiable GP posteriors and predictive distributions, thus allowing fast meta training. We demonstrate considerable improvement over the previous approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2021

Principal component analysis for Gaussian process posteriors

This paper proposes an extension of principal component analysis for Gau...
research
11/25/2013

On Approximate Inference for Generalized Gaussian Process Models

A generalized Gaussian process model (GGPM) is a unifying framework that...
research
12/20/2017

Laplace approximation and the natural gradient for Gaussian process regression with the heteroscedastic Student-t model

This paper considers the Laplace method to derive approximate inference ...
research
06/02/2020

Meta Learning as Bayes Risk Minimization

Meta-Learning is a family of methods that use a set of interrelated task...
research
01/03/2021

Meta-Learning Conjugate Priors for Few-Shot Bayesian Optimization

Bayesian Optimization is methodology used in statistical modelling that ...
research
02/28/2023

Interactive Segmentation as Gaussian Process Classification

Click-based interactive segmentation (IS) aims to extract the target obj...
research
04/19/2019

Meta-Weighted Gaussian Process Experts for Personalized Forecasting of AD Cognitive Changes

We introduce a novel personalized Gaussian Process Experts (pGPE) model ...

Please sign up or login with your details

Forgot password? Click here to reset