DeepAI AI Chat
Log In Sign Up

Recovery guarantees for polynomial approximation from dependent data with outliers

by   Lam Si Tung Ho, et al.
University of Waterloo
The University of Texas at Austin
Carnegie Mellon University
Dalhousie University

Learning non-linear systems from noisy, limited, and/or dependent data is an important task across various scientific fields including statistics, engineering, computer science, mathematics, and many more. In general, this learning task is ill-posed; however, additional information about the data's structure or on the behavior of the unknown function can make the task well-posed. In this work, we study the problem of learning nonlinear functions from corrupted and dependent data. The learning problem is recast as a sparse robust linear regression problem where we incorporate both the unknown coefficients and the corruptions in a basis pursuit framework. The main contribution of our paper is to provide a reconstruction guarantee for the associated ℓ_1-optimization problem where the sampling matrix is formed from dependent data. Specifically, we prove that the sampling matrix satisfies the null space property and the stable null space property, provided that the data is compact and satisfies a suitable concentration inequality. We show that our recovery results are applicable to various types of dependent data such as exponentially strongly α-mixing data, geometrically C-mixing data, and uniformly ergodic Markov chain. Our theoretical results are verified via several numerical simulations.


page 1

page 2

page 3

page 4


Efficient Noise-Blind ℓ_1-Regression of Nonnegative Compressible Signals

In compressed sensing the goal is to recover a signal from as few as pos...

Finite-Time Analysis of Q-Learning with Linear Function Approximation

In this paper, we consider the model-free reinforcement learning problem...

Truncated Sparse Approximation Property and Truncated q-Norm Minimization

This paper considers approximately sparse signal and low-rank matrix's r...

Robust Non-linear Regression: A Greedy Approach Employing Kernels with Application to Image Denoising

We consider the task of robust non-linear regression in the presence of ...

Joint Sparse Recovery Using Signal Space Matching Pursuit

In this paper, we put forth a new joint sparse recovery algorithm called...

Neutron reflectometry analysis: using model-dependent methods

Neutron reflectometry analysis is an inherently ill-posed, which is to s...

Three rates of convergence or separation via U-statistics in a dependent framework

Despite the ubiquity of U-statistics in modern Probability and Statistic...