Dimension-free PAC-Bayesian bounds for matrices, vectors, and linear least squares regression

12/07/2017
by   Olivier Catoni, et al.
0

This paper is focused on dimension-free PAC-Bayesian bounds, under weak polynomial moment assumptions, allowing for heavy tailed sample distributions. It covers the estimation of the mean of a vector or a matrix, with applications to least squares linear regression. Special efforts are devoted to the estimation of Gram matrices, due to their prominent role in high-dimension data analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2018

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

In this paper, we present a new estimator of the mean of a random vector...
research
10/23/2016

Simpler PAC-Bayesian Bounds for Hostile Data

PAC-Bayesian learning bounds are of the utmost interest to the learning ...
research
10/18/2022

Dimension-free Bounds for Sum of Dependent Matrices and Operators with Heavy-Tailed Distribution

We study the deviation inequality for a sum of high-dimensional random m...
research
12/06/2019

Improved PAC-Bayesian Bounds for Linear Regression

In this paper, we improve the PAC-Bayesian error bound for linear regres...
research
05/02/2018

ℓ_1-regression with Heavy-tailed Distributions

In this paper, we consider the problem of linear regression with heavy-t...
research
09/24/2018

Moment bounds for autocovariance matrices under dependence

The goal of this paper is to obtain expectation bounds for the deviation...
research
04/12/2021

Semi-Infinite Linear Regression and Its Applications

Finite linear least squares is one of the core problems of numerical lin...

Please sign up or login with your details

Forgot password? Click here to reset