Learning Manifold Implicitly via Explicit Heat-Kernel Learning

10/05/2020
by   Yufan Zhou, et al.
0

Manifold learning is a fundamental problem in machine learning with numerous applications. Most of the existing methods directly learn the low-dimensional embedding of the data in some high-dimensional space, and usually lack the flexibility of being directly applicable to down-stream applications. In this paper, we propose the concept of implicit manifold learning, where manifold information is implicitly obtained by learning the associated heat kernel. A heat kernel is the solution of the corresponding heat equation, which describes how "heat" transfers on the manifold, thus containing ample geometric information of the manifold. We provide both practical algorithm and theoretical analysis of our framework. The learned heat kernel can be applied to various kernel-based machine learning models, including deep generative models (DGM) for data generation and Stein Variational Gradient Descent for Bayesian inference. Extensive experiments show that our framework can achieve state-of-the-art results compared to existing methods for the two tasks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 18

page 19

page 20

page 21

02/01/2011

Vector Diffusion Maps and the Connection Laplacian

We introduce vector diffusion maps (VDM), a new mathematical framework ...
05/01/2014

Geodesic Distance Function Learning via Heat Flow on Vector Fields

Learning a distance function or metric on a given data manifold is of gr...
04/28/2020

Visualization of Unsteady Flow Using Heat Kernel Signatures

We introduce a new technique to visualize complex flowing phenomena by u...
12/11/2013

Heat kernel coupling for multiple graph analysis

In this paper, we introduce heat kernel coupling (HKC) as a method of co...
02/05/2017

Exact heat kernel on a hypersphere and its applications in kernel SVM

Many contemporary statistical learning methods assume a Euclidean featur...
03/26/2018

Heat Kernel analysis of Syntactic Structures

We consider two different data sets of syntactic parameters and we discu...
04/18/2019

A kernel-based method for coarse graining complex dynamical systems

We present a novel kernel-based machine learning algorithm for identifyi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.