Global optimization for low-dimensional switching linear regression and bounded-error estimation

07/18/2017
by   Fabien Lauer, et al.
0

The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local optimization heuristics without global optimality guarantees or with guarantees valid only under restrictive conditions, the proposed approach always yields a solution with a certificate of global optimality. This approach relies on a branch-and-bound strategy for which we devise lower bounds that can be efficiently computed. In order to obtain scalable algorithms with respect to the number of data, we directly optimize the model parameters in a continuous optimization setting without involving integer variables. Numerical experiments show that the proposed algorithms offer a higher accuracy than convex relaxations with a reasonable computational burden for hybrid system identification. In addition, we discuss how bounded-error estimation is related to robust estimation in the presence of outliers and exact recovery under sparse noise, for which we also obtain promising numerical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/09/2018

Robust and Sparse Regression in GLM by Stochastic Optimization

The generalized linear model (GLM) plays a key role in regression analys...
research
12/09/2022

The Hybridization of Branch and Bound with Metaheuristics for Nonconvex Multiobjective Optimization

A hybrid framework combining the branch and bound method with multiobjec...
research
02/28/2020

The estimation error of general first order methods

Modern large-scale statistical models require to estimate thousands to m...
research
08/24/2022

Outlier Robust and Sparse Estimation of Linear Regression Coefficients

We consider outlier robust and sparse estimation of linear regression co...
research
10/29/2020

Sparse Signal Reconstruction for Nonlinear Models via Piecewise Rational Optimization

We propose a method to reconstruct sparse signals degraded by a nonlinea...
research
01/27/2017

Subset Selection for Multiple Linear Regression via Optimization

Subset selection in multiple linear regression is to choose a subset of ...
research
07/09/2019

Hybrid system identification using switching density networks

Behaviour cloning is a commonly used strategy for imitation learning and...

Please sign up or login with your details

Forgot password? Click here to reset