Semi-Infinite Linear Regression and Its Applications

04/12/2021
by   Paz Fink Shustin, et al.
0

Finite linear least squares is one of the core problems of numerical linear algebra, with countless applications across science and engineering. Consequently, there is a rich and ongoing literature on algorithms for solving linear least squares problems. In this paper, we explore a variant in which the system's matrix has one infinite dimension (i.e., it is a quasimatrix). We call such problems semi-infinite linear regression problems. As we show, the semi-infinite case arises in several applications, such supervised learning and function approximation, and allows for novel interpretations of existing algorithms. We explore semi-infinite linear regression rigorously and algorithmically. To that end, we give a formal framework for working with quasimatrices, and generalize several algorithms designed for finite problem to the infinite case. Finally, we suggest the use of various sampling methods for obtaining an approximate solution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/16/2019

Fast, Provably convergent IRLS Algorithm for p-norm Linear Regression

Linear regression in ℓ_p-norm is a canonical optimization problem that a...
research
08/09/2019

Linear regression in the Bayesian framework

These notes aim at clarifying different strategies to perform linear reg...
research
05/18/2021

Approximate solutions of convex semi-infinite optimization problems in finitely many iterations

We develop two adaptive discretization algorithms for convex semi-infini...
research
02/22/2016

Sparse Linear Regression via Generalized Orthogonal Least-Squares

Sparse linear regression, which entails finding a sparse solution to an ...
research
06/06/2018

Reverse iterative volume sampling for linear regression

We study the following basic machine learning task: Given a fixed set of...
research
11/13/2020

Determinantal Point Processes Implicitly Regularize Semi-parametric Regression Problems

Semi-parametric regression models are used in several applications which...
research
12/07/2017

Dimension-free PAC-Bayesian bounds for matrices, vectors, and linear least squares regression

This paper is focused on dimension-free PAC-Bayesian bounds, under weak ...

Please sign up or login with your details

Forgot password? Click here to reset