Sparse joint shift in multinomial classification

03/29/2023
by   Dirk Tasche, et al.
0

Sparse joint shift (SJS) was recently proposed as a tractable model for general dataset shift which may cause changes to the marginal distributions of features and labels as well as the posterior probabilities and the class-conditional feature distributions. Fitting SJS for a target dataset without label observations may produce valid predictions of labels and estimates of class prior probabilities. We present new results on the transmission of SJS from sets of features to larger sets of features, a conditional correction formula for the class posterior probabilities under the target distribution, identifiability of SJS, and the relationship between SJS and covariate shift. In addition, we point out inconsistencies in the algorithms which were proposed for estimating the characteristics of SJS, as they could hamper the search for optimal solutions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/29/2022

Factorizable Joint Shift in Multinomial Classification

Factorizable joint shift (FJS) was recently proposed as a type of datase...
research
09/18/2022

Estimating and Explaining Model Performance When Both Covariates and Labels Shift

Deployed machine learning (ML) models often encounter new user data that...
research
12/10/2021

Recalibration of Predictive Models as Approximate Probabilistic Updates

The output of predictive models is routinely recalibrated by reconciling...
research
02/06/2022

A new similarity measure for covariate shift with applications to nonparametric regression

We study covariate shift in the context of nonparametric regression. We ...
research
03/05/2018

Marginal Singularity, and the Benefits of Labels in Covariate-Shift

We present new minimax results that concisely capture the relative benef...
research
07/22/2016

On the Use of Sparse Filtering for Covariate Shift Adaptation

In this paper we formally analyse the use of sparse filtering algorithms...
research
10/23/2020

Robust Correction of Sampling Bias Using Cumulative Distribution Functions

Varying domains and biased datasets can lead to differences between the ...

Please sign up or login with your details

Forgot password? Click here to reset