Open-Set Likelihood Maximization for Few-Shot Learning

01/20/2023
by   Malik Boudiaf, et al.
6

We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i.e. classifying instances among a set of classes for which we only have a few labeled samples, while simultaneously detecting instances that do not belong to any known class. We explore the popular transductive setting, which leverages the unlabelled query instances at inference. Motivated by the observation that existing transductive methods perform poorly in open-set scenarios, we propose a generalization of the maximum likelihood principle, in which latent scores down-weighing the influence of potential outliers are introduced alongside the usual parametric model. Our formulation embeds supervision constraints from the support set and additional penalties discouraging overconfident predictions on the query set. We proceed with a block-coordinate descent, with the latent scores and parametric model co-optimized alternately, thereby benefiting from each other. We call our resulting formulation Open-Set Likelihood Optimization (OSLO). OSLO is interpretable and fully modular; it can be applied on top of any pre-trained model seamlessly. Through extensive experiments, we show that our method surpasses existing inductive and transductive methods on both aspects of open-set recognition, namely inlier classification and outlier detection.

READ FULL TEXT
research
06/18/2022

Model-Agnostic Few-Shot Open-Set Recognition

We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i.e. classi...
research
07/29/2021

Bayesian Embeddings for Few-Shot Open World Recognition

As autonomous decision-making agents move from narrow operating environm...
research
10/26/2022

Towards Practical Few-Shot Query Sets: Transductive Minimum Description Length Inference

Standard few-shot benchmarks are often built upon simplifying assumption...
research
06/28/2022

Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spotting

Keyword spotting is the task of detecting a keyword in streaming audio. ...
research
01/26/2023

Explore the Power of Dropout on Few-shot Learning

The generalization power of the pre-trained model is the key for few-sho...
research
04/07/2021

OpenGAN: Open-Set Recognition via Open Data Generation

Real-world machine learning systems need to analyze novel testing data t...
research
12/07/2022

A Simple Nadaraya-Watson Head can offer Explainable and Calibrated Classification

In this paper, we empirically analyze a simple, non-learnable, and nonpa...

Please sign up or login with your details

Forgot password? Click here to reset