Inference with generalizable classifier predictions

06/14/2021
by   Ciaran Evans, et al.
0

This paper addresses the problem of making statistical inference about a population that can only be identified through classifier predictions. The problem is motivated by scientific studies in which human labels of a population are replaced by a classifier. For downstream analysis of the population based on classifier predictions to be sound, the predictions must generalize equally across experimental conditions. In this paper, we formalize the task of statistical inference using classifier predictions, and propose bootstrap procedures to allow inference with a generalizable classifier. We demonstrate the performance of our methods through extensive simulations and a case study with live cell imaging data.

READ FULL TEXT
research
01/07/2019

Bootstrap inference for the finite population total under complex sampling designs

Bootstrap is a useful tool for making statistical inference, but it may ...
research
06/28/2021

What to do if N is two?

The field of in-vivo neurophysiology currently uses statistical standard...
research
02/10/2021

Once is Never Enough: Foundations for Sound Statistical Inference in Tor Network Experimentation

Tor is a popular low-latency anonymous communication system that focuses...
research
06/07/2022

Inferring Unfairness and Error from Population Statistics in Binary and Multiclass Classification

We propose methods for making inferences on the fairness and accuracy of...
research
11/08/2020

Performative Prediction in a Stateful World

Deployed supervised machine learning models make predictions that intera...
research
01/15/2020

Generalized Bayesian Quantification Learning

Quantification Learning is the task of prevalence estimation for a test ...
research
03/27/2020

Post-sampling crowdsourced data to allow reliable statistical inference: the case of food price indices in Nigeria

Sound policy and decision making in developing countries is often limite...

Please sign up or login with your details

Forgot password? Click here to reset