On the minimax rate of the Gaussian sequence model under bounded convex constraints

01/18/2022
by   Matey Neykov, et al.
0

We determine the exact minimax rate of a Gaussian sequence model under bounded convex constraints, purely in terms of the local geometry of the given constraint set K. Our main result shows that the minimax risk (up to constant factors) under the squared L_2 loss is given by ϵ^*2∧diam(K)^2 with ϵ^* = sup{ϵ : ϵ^2/σ^2≤log M^loc(ϵ)}, where log M^loc(ϵ) denotes the local entropy of the set K, and σ^2 is the variance of the noise. We utilize our abstract result to re-derive known minimax rates for some special sets K such as hyperrectangles, ellipses, and more generally quadratically convex orthosymmetric sets. Finally, we extend our results to the unbounded case with known σ^2 to show that the minimax rate in that case is ϵ^*2.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2020

Minimax bounds for estimating multivariate Gaussian location mixtures

We prove minimax bounds for estimating Gaussian location mixtures on ℝ^d...
research
03/13/2023

Universal coding, intrinsic volumes, and metric complexity

We study sequential probability assignment in the Gaussian setting, wher...
research
05/29/2023

On the Variance, Admissibility, and Stability of Empirical Risk Minimization

It is well known that Empirical Risk Minimization (ERM) with squared los...
research
10/21/2017

A Tight Excess Risk Bound via a Unified PAC-Bayesian-Rademacher-Shtarkov-MDL Complexity

We present a novel notion of complexity that interpolates between and ge...
research
03/22/2023

Noisy recovery from random linear observations: Sharp minimax rates under elliptical constraints

Estimation problems with constrained parameter spaces arise in various s...
research
06/21/2023

Entropic characterization of optimal rates for learning Gaussian mixtures

We consider the question of estimating multi-dimensional Gaussian mixtur...
research
10/29/2018

Dominating Points of Gaussian Extremes

We quantify the large deviations of Gaussian extreme value statistics on...

Please sign up or login with your details

Forgot password? Click here to reset