The Hitchhiker's Guide to Prior-Shift Adaptation

06/22/2021
by   Tomas Sipka, et al.
0

In many computer vision classification tasks, class priors at test time often differ from priors on the training set. In the case of such prior shift, classifiers must be adapted correspondingly to maintain close to optimal performance. This paper analyzes methods for adaptation of probabilistic classifiers to new priors and for estimating new priors on an unlabeled test set. We propose a novel method to address a known issue of prior estimation methods based on confusion matrices, where inconsistent estimates of decision probabilities and confusion matrices lead to negative values in the estimated priors. Experiments on fine-grained image classification datasets provide insight into the best practice of prior shift estimation and classifier adaptation and show that the proposed method achieves state-of-the-art results in prior adaptation. Applying the best practice to two tasks with naturally imbalanced priors, learning from web-crawled images and plant species classification, increased the recognition accuracy by 1.1 respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2018

Improving CNN classifiers by estimating test-time priors

The problem of different training and test set class priors is addressed...
research
07/11/2021

Positive-Unlabeled Classification under Class-Prior Shift: A Prior-invariant Approach Based on Density Ratio Estimation

Learning from positive and unlabeled (PU) data is an important problem i...
research
07/02/2022

Test-time Adaptation with Calibration of Medical Image Classification Nets for Label Distribution Shift

Class distribution plays an important role in learning deep classifiers....
research
06/16/2021

Knowledge-Adaptation Priors

Humans and animals have a natural ability to quickly adapt to their surr...
research
07/02/2020

Posterior Model Adaptation With Updated Priors

Classification approaches based on the direct estimation and analysis of...
research
06/12/2023

Making Binary Classification from Multiple Unlabeled Datasets Almost Free of Supervision

Training a classifier exploiting a huge amount of supervised data is exp...
research
06/10/2022

Lightweight Conditional Model Extrapolation for Streaming Data under Class-Prior Shift

We introduce LIMES, a new method for learning with non-stationary stream...

Please sign up or login with your details

Forgot password? Click here to reset