Semi-Infinite Linear Regression and Its Applications

04/12/2021
by   Paz Fink Shustin, et al.
0

Finite linear least squares is one of the core problems of numerical linear algebra, with countless applications across science and engineering. Consequently, there is a rich and ongoing literature on algorithms for solving linear least squares problems. In this paper, we explore a variant in which the system's matrix has one infinite dimension (i.e., it is a quasimatrix). We call such problems semi-infinite linear regression problems. As we show, the semi-infinite case arises in several applications, such supervised learning and function approximation, and allows for novel interpretations of existing algorithms. We explore semi-infinite linear regression rigorously and algorithmically. To that end, we give a formal framework for working with quasimatrices, and generalize several algorithms designed for finite problem to the infinite case. Finally, we suggest the use of various sampling methods for obtaining an approximate solution.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/16/2019

Fast, Provably convergent IRLS Algorithm for p-norm Linear Regression

Linear regression in ℓ_p-norm is a canonical optimization problem that a...
08/09/2019

Linear regression in the Bayesian framework

These notes aim at clarifying different strategies to perform linear reg...
05/18/2021

Approximate solutions of convex semi-infinite optimization problems in finitely many iterations

We develop two adaptive discretization algorithms for convex semi-infini...
02/22/2016

Sparse Linear Regression via Generalized Orthogonal Least-Squares

Sparse linear regression, which entails finding a sparse solution to an ...
06/06/2018

Reverse iterative volume sampling for linear regression

We study the following basic machine learning task: Given a fixed set of...
11/13/2020

Determinantal Point Processes Implicitly Regularize Semi-parametric Regression Problems

Semi-parametric regression models are used in several applications which...
09/16/2020

An Intrinsic Treatment of Stochastic Linear Regression

Linear regression is perhaps one of the most popular statistical concept...