Classification of Superstatistical Features in High Dimensions

04/06/2023
by   Urte Adomaityte, et al.
10

We characterise the learning of a mixture of two clouds of data points with generic centroids via empirical risk minimisation in the high dimensional regime, under the assumptions of generic convex loss and convex regularisation. Each cloud of data points is obtained by sampling from a possibly uncountable superposition of Gaussian distributions, whose variance has a generic probability density ϱ. Our analysis covers therefore a large family of data distributions, including the case of power-law-tailed distributions with no covariance. We study the generalisation performance of the obtained estimator, we analyse the role of regularisation, and the dependence of the separability transition on the distribution scale parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2022

Fluctuations, Bias, Variance Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension

From the sampling of data to the initialisation of parameters, randomnes...
research
01/31/2017

Prototypal Analysis and Prototypal Regression

Prototypal analysis is introduced to overcome two shortcomings of archet...
research
05/26/2022

Gaussian Universality of Linear Classifiers with Random Labels in High-Dimension

While classical in many theoretical settings, the assumption of Gaussian...
research
07/30/2020

Visual Analysis of Multi-Parameter Distributions across Ensembles

For an ensemble of data points in a multi-parameter space, we present a ...
research
06/19/2022

Frank-Wolfe-based Algorithms for Approximating Tyler's M-estimator

Tyler's M-estimator is a well known procedure for robust and heavy-taile...
research
06/07/2021

Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions

Generalised linear models for multi-class classification problems are on...
research
09/27/2022

A new method to construct high-dimensional copulas with Bernoulli and Coxian-2 distributions

We propose an approach to construct a new family of generalized Farlie-G...

Please sign up or login with your details

Forgot password? Click here to reset