A Hypergradient Approach to Robust Regression without Correspondence

11/30/2020
by   Yujia Xie, et al.
0

We consider a regression problem, where the correspondence between input and output data is not available. Such shuffled data is commonly observed in many real world problems. Taking flow cytometry as an example, the measuring instruments are unable to preserve the correspondence between the samples and the measurements. Due to the combinatorial nature, most of existing methods are only applicable when the sample size is small, and limited to linear regression models. To overcome such bottlenecks, we propose a new computational framework - ROBOT- for the shuffled regression problem, which is applicable to large data and complex models. Specifically, we propose to formulate the regression without correspondence as a continuous optimization problem. Then by exploiting the interaction between the regression model and the data correspondence, we propose to develop a hypergradient approach based on differentiable programming techniques. Such a hypergradient approach essentially views the data correspondence as an operator of the regression, and therefore allows us to find a better descent direction for the model parameter by differentiating through the data correspondence. ROBOT is quite general, and can be further extended to the inexact correspondence setting, where the input and output data are not necessarily exactly aligned. Thorough numerical experiments show that ROBOT achieves better performance than existing methods in both linear and nonlinear regression tasks, including real-world applications such as flow cytometry and multi-object tracking.

READ FULL TEXT

page 12

page 15

page 31

research
09/30/2022

Shuffled linear regression through graduated convex relaxation

The shuffled linear regression problem aims to recover linear relationsh...
research
04/29/2015

A Deep Learning Model for Structured Outputs with High-order Interaction

Many real-world applications are associated with structured data, where ...
research
06/01/2019

Robust approximate linear regression without correspondence

Estimating regression coefficients using unordered multisets of covariat...
research
08/10/2023

PlankAssembly: Robust 3D Reconstruction from Three Orthographic Views with Learnt Shape Programs

In this paper, we develop a new method to automatically convert 2D line ...
research
01/11/2017

Multivariate Regression with Grossly Corrupted Observations: A Robust Approach and its Applications

This paper studies the problem of multivariate linear regression where a...
research
07/02/2020

Partial Trace Regression and Low-Rank Kraus Decomposition

The trace regression model, a direct extension of the well-studied linea...
research
08/03/2023

Functional Data Regression Reconciles with Excess Bases

As the development of measuring instruments and computers has accelerate...

Please sign up or login with your details

Forgot password? Click here to reset