Minimax optimal approaches to the label shift problem

03/23/2020
by   Subha Maity, et al.
0

We study minimax rates of convergence in the label shift problem. In addition to the usual setting in which the learner only has access to unlabeled examples from the target domain, we also consider the setting in which a small number of labeled examples from the target domain are available to the learner. Our study reveals a difference in the difficulty of the label shift problem in the two settings. We attribute this difference to the availability of data from the target domain to estimate the class conditional distributions in the latter setting. We also show that a distributional matching approach is minimax rate-optimal in the former setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2018

A Generalized Neyman-Pearson Criterion for Optimal Domain Adaptation

In the problem domain adaptation for binary classification, the learner ...
research
03/22/2019

Regularized Learning for Domain Adaptation under Label Shifts

We propose Regularized Learning under Label shifts (RLLS), a principled ...
research
10/23/2020

Coping with Label Shift via Distributionally Robust Optimisation

The label shift problem refers to the supervised learning setting where ...
research
01/18/2019

Adapting Convolutional Neural Networks for Geographical Domain Shift

We present the winning solution for the Inclusive Images Competition org...
research
09/19/2023

Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation

We consider the problem of learning a model from multiple heterogeneous ...
research
05/26/2022

Undersampling is a Minimax Optimal Robustness Intervention in Nonparametric Classification

While a broad range of techniques have been proposed to tackle distribut...
research
05/31/2023

Online Label Shift: Optimal Dynamic Regret meets Practical Algorithms

This paper focuses on supervised and unsupervised online label shift, wh...

Please sign up or login with your details

Forgot password? Click here to reset