Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuation

04/22/2021
by   Toshiaki Tsukurimichi, et al.
0

In practical data analysis under noisy environment, it is common to first use robust methods to identify outliers, and then to conduct further analysis after removing the outliers. In this paper, we consider statistical inference of the model estimated after outliers are removed, which can be interpreted as a selective inference (SI) problem. To use conditional SI framework, it is necessary to characterize the events of how the robust method identifies outliers. Unfortunately, the existing methods cannot be directly used here because they are applicable to the case where the selection events can be represented by linear/quadratic constraints. In this paper, we propose a conditional SI method for popular robust regressions by using homotopy method. We show that the proposed conditional SI method is applicable to a wide class of robust regression and outlier detection methods and has good empirical performance on both synthetic data and real data experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/26/2018

Detecting Outliers in Data with Correlated Measures

Advances in sensor technology have enabled the collection of large-scale...
research
07/19/2018

Simple robust genomic prediction and outlier detection for a multi-environmental field trial

The aim of plant breeding trials is often to identify germplasms that ar...
research
10/02/2021

Functional outlier detection for density-valued data with application to robustify distribution to distribution regression

Distributional data analysis, concerned with statistical analysis and mo...
research
12/21/2016

Detecting Unusual Input-Output Associations in Multivariate Conditional Data

Despite tremendous progress in outlier detection research in recent year...
research
04/25/2021

Robust selection of predictors and conditional outlier detection in a perturbed large-dimensional regression context

This paper presents a fast methodology, called ROBOUT, to identify outli...
research
09/11/2023

Boundary Peeling: Outlier Detection Method Using One-Class Peeling

Unsupervised outlier detection constitutes a crucial phase within data a...
research
11/29/2017

Valid Inference Corrected for Outlier Removal

Ordinary least square (OLS) estimation of a linear regression model is w...

Please sign up or login with your details

Forgot password? Click here to reset