Sinkhorn Barycenters with Free Support via Frank-Wolfe Algorithm

05/30/2019
by   Giulia Luise, et al.
0

We present a novel algorithm to estimate the barycenter of arbitrary probability distributions with respect to the Sinkhorn divergence. Based on a Frank-Wolfe optimization strategy, our approach proceeds by populating the support of the barycenter incrementally, without requiring any pre-allocation. We consider discrete as well as continuous distributions, proving convergence rates of the proposed algorithm in both settings. Key elements of our analysis are a new result showing that the Sinkhorn divergence on compact domains has Lipschitz continuous gradient with respect to the Total Variation and a characterization of the sample complexity of Sinkhorn potentials. Experiments validate the effectiveness of our method in practice.

READ FULL TEXT
research
02/03/2020

Limit Distribution for Smooth Total Variation and χ^2-Divergence in High Dimensions

Statistical divergences are ubiquitous in machine learning as tools for ...
research
01/29/2021

On f-divergences between Cauchy distributions

We prove that the f-divergences between univariate Cauchy distributions ...
research
08/01/2023

Divergence of the ADAM algorithm with fixed-stepsize: a (very) simple example

A very simple unidimensional function with Lipschitz continuous gradient...
research
12/02/2021

Sample Complexity of Robust Reinforcement Learning with a Generative Model

The Robust Markov Decision Process (RMDP) framework focuses on designing...
research
08/02/2023

Subgradient Langevin Methods for Sampling from Non-smooth Potentials

This paper is concerned with sampling from probability distributions π o...
research
06/19/2018

Adaptive Bayesian Estimation of Mixed Discrete-Continuous Distributions under Smoothness and Sparsity

We consider nonparametric estimation of a mixed discrete-continuous dist...
research
08/04/2021

Sparse Continuous Distributions and Fenchel-Young Losses

Exponential families are widely used in machine learning; they include m...

Please sign up or login with your details

Forgot password? Click here to reset