Hessian transport Gradient flows

05/11/2019
by   Wuchen Li, et al.
1

We derive new gradient flows of divergence functions in the probability space embedded with a class of Riemannian metrics. The Riemannian metric tensor is built from the transported Hessian operator of an entropy function. The new gradient flow is a generalized Fokker-Planck equation and is associated with a stochastic differential equation that depends on the reference measure. Several examples of Hessian transport gradient flows and the associated stochastic differential equations are presented, including the ones for the reverse Kullback--Leibler divergence, alpha-divergence, Hellinger distance, Pearson divergence, and Jenson--Shannon divergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2018

Wasserstein-Riemannian Geometry of Positive-definite Matrices

The Wasserstein distance on multivariate non-degenerate Gaussian densiti...
research
09/07/2022

Conformal Mirror Descent with Logarithmic Divergences

The logarithmic divergence is an extension of the Bregman divergence mot...
research
08/05/2018

Prediction in Riemannian metrics derived from divergence functions

Divergence functions are interesting discrepancy measures. Even though t...
research
05/18/2023

Deep Metric Tensor Regularized Policy Gradient

Policy gradient algorithms are an important family of deep reinforcement...
research
01/26/2022

Towards Sharp Stochastic Zeroth Order Hessian Estimators over Riemannian Manifolds

We study Hessian estimators for real-valued functions defined over an n-...
research
11/24/2019

A Non-conditional Uniform Divergence Criteria of Projection Method for Compact Operator Equation

Projection methods (including collocation methods) are always considered...
research
07/17/2022

Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flows

We propose an algorithm to estimate the path-gradient of both the revers...

Please sign up or login with your details

Forgot password? Click here to reset