Hamilton-Jacobi equations on graphs with applications to semi-supervised learning and data depth

02/17/2022
by   Jeff Calder, et al.
16

Shortest path graph distances are widely used in data science and machine learning, since they can approximate the underlying geodesic distance on the data manifold. However, the shortest path distance is highly sensitive to the addition of corrupted edges in the graph, either through noise or an adversarial perturbation. In this paper we study a family of Hamilton-Jacobi equations on graphs that we call the p-eikonal equation. We show that the p-eikonal equation with p=1 is a provably robust distance-type function on a graph, and the p→∞ limit recovers shortest path distances. While the p-eikonal equation does not correspond to a shortest-path graph distance, we nonetheless show that the continuum limit of the p-eikonal equation on a random geometric graph recovers a geodesic density weighted distance in the continuum. We consider applications of the p-eikonal equation to data depth and semi-supervised learning, and use the continuum limit to prove asymptotic consistency results for both applications. Finally, we show the results of experiments with data depth and semi-supervised learning on real image datasets, including MNIST, FashionMNIST and CIFAR-10, which show that the p-eikonal equation offers significantly better results compared to shortest path distances.

READ FULL TEXT

page 9

page 14

page 23

page 39

page 40

research
02/14/2012

Semi-supervised Learning with Density Based Distances

We present a simple, yet effective, approach to Semi-Supervised Learning...
research
06/27/2012

Shortest path distance in random k-nearest neighbor graphs

Consider a weighted or unweighted k-nearest neighbor graph that has been...
research
12/22/2021

Using Machine Learning Predictions to Speed-up Dijkstra's Shortest Path Algorithm

We study the use of machine learning techniques to solve a fundamental s...
research
12/17/2020

Balancing Geometry and Density: Path Distances on High-Dimensional Data

New geometric and computational analyses of power-weighted shortest-path...
research
10/22/2019

Order distances and split systems

Given a distance D on a finite set X with n elements, it is interesting ...
research
12/12/2014

Manifold Matching using Shortest-Path Distance and Joint Neighborhood Selection

Matching datasets of multiple modalities has become an important task in...
research
08/11/2021

Edge-Path Bundling: A Less Ambiguous Edge Bundling Approach

Edge bundling techniques cluster edges with similar attributes (i.e. sim...

Please sign up or login with your details

Forgot password? Click here to reset