Robust Optimization and Inference on Manifolds

06/11/2020
by   Lizhen Lin, et al.
0

We propose a robust and scalable procedure for general optimization and inference problems on manifolds leveraging the classical idea of `median-of-means' estimation. This is motivated by ubiquitous examples and applications in modern data science in which a statistical learning problem can be cast as an optimization problem over manifolds. Being able to incorporate the underlying geometry for inference while addressing the need for robustness and scalability presents great challenges. We address these challenges by first proving a key lemma that characterizes some crucial properties of geometric medians on manifolds. In turn, this allows us to prove robustness and tighter concentration of our proposed final estimator in a subsequent theorem. This estimator aggregates a collection of subset estimators by taking their geometric median over the manifold. We illustrate bounds on this estimator via calculations in explicit examples. The robustness and scalability of the procedure is illustrated in numerical examples on both simulated and real data sets.

READ FULL TEXT
research
01/28/2021

Robust Extrinsic Regression Analysis for Manifold Valued Data

Recently, there has been a growing need in analyzing data on manifolds o...
research
07/06/2023

The Geometric Median and Applications to Robust Mean Estimation

This paper is devoted to the statistical and numerical properties of the...
research
04/09/2017

Distributed Statistical Estimation and Rates of Convergence in Normal Approximation

This paper presents new algorithms for distributed statistical estimatio...
research
07/09/2020

Robust Geodesic Regression

This paper studies robust regression for data on Riemannian manifolds. G...
research
10/26/2018

Communication Efficient Parallel Algorithms for Optimization on Manifolds

The last decade has witnessed an explosion in the development of models,...
research
03/04/2021

Variance Reduced Median-of-Means Estimator for Byzantine-Robust Distributed Inference

This paper develops an efficient distributed inference algorithm, which ...
research
12/29/2020

Data driven Dirichlet sampling on manifolds

This article presents a novel method to sampling on manifolds based on t...

Please sign up or login with your details

Forgot password? Click here to reset