An elementary analysis of ridge regression with random design

03/16/2022
by   Jaouad Mourtada, et al.
0

In this note, we provide an elementary analysis of the prediction error of ridge regression with random design. The proof is short and self-contained. In particular, it bypasses the use of Rudelson's deviation inequality for covariance matrices, through a combination of exchangeability arguments, matrix perturbation and operator convexity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/24/2019

A note on the elementary HDX construction of Kaufman-Oppenheim

In this note, we give a self-contained and elementary proof of the eleme...
research
06/13/2011

Random design analysis of ridge regression

This work gives a simultaneous analysis of both the ordinary least squar...
research
09/04/2019

Optimal translational-rotational invariant dictionaries for images

We provide the construction of a set of square matrices whose translates...
research
02/10/2020

Distributed Learning with Dependent Samples

This paper focuses on learning rate analysis of distributed kernel ridge...
research
02/09/2017

Fixing an error in Caponnetto and de Vito (2007)

The seminal paper of Caponnetto and de Vito (2007) provides minimax-opti...
research
07/21/2023

Bernstein approximation and beyond: proofs by means of elementary probability theory

Bernstein polynomials provide a constructive proof for the Weierstrass a...
research
07/21/2021

Random Simple-Homotopy Theory

We implement an algorithm RSHT (Random Simple-Homotopy) to study the sim...

Please sign up or login with your details

Forgot password? Click here to reset