A Wasserstein Minimum Velocity Approach to Learning Unnormalized Models

02/18/2020
by   Ziyu Wang, et al.
9

Score matching provides an effective approach to learning flexible unnormalized models, but its scalability is limited by the need to evaluate a second-order derivative. In this paper, we present a scalable approximation to a general family of learning objectives including score matching, by observing a new connection between these objectives and Wasserstein gradient flows. We present applications with promise in learning neural density estimators on manifolds, and training implicit variational and Wasserstein auto-encoders with a manifold-valued prior.

READ FULL TEXT

page 15

page 17

page 18

page 19

research
05/17/2019

Sliced Score Matching: A Scalable Approach to Density and Score Estimation

Score matching is a popular method for estimating unnormalized statistic...
research
09/29/2022

From geodesic extrapolation to a variational BDF2 scheme for Wasserstein gradient flows

We introduce a time discretization for Wasserstein gradient flows based ...
research
12/04/2021

Variational Wasserstein gradient flow

The gradient flow of a function over the space of probability densities ...
research
01/20/2020

TPFA Finite Volume Approximation of Wasserstein Gradient Flows

Numerous infinite dimensional dynamical systems arising in different fie...
research
06/17/2022

Spherical Sliced-Wasserstein

Many variants of the Wasserstein distance have been introduced to reduce...
research
10/24/2022

On the failure of variational score matching for VAE models

Score matching (SM) is a convenient method for training flexible probabi...

Please sign up or login with your details

Forgot password? Click here to reset