Hyperbolic Diffusion Embedding and Distance for Hierarchical Representation Learning

05/30/2023
by   Ya-Wei Eileen Lin, et al.
0

Finding meaningful representations and distances of hierarchical data is important in many fields. This paper presents a new method for hierarchical data embedding and distance. Our method relies on combining diffusion geometry, a central approach to manifold learning, and hyperbolic geometry. Specifically, using diffusion geometry, we build multi-scale densities on the data, aimed to reveal their hierarchical structure, and then embed them into a product of hyperbolic spaces. We show theoretically that our embedding and distance recover the underlying hierarchical structure. In addition, we demonstrate the efficacy of the proposed method and its advantages compared to existing methods on graph embedding benchmarks and hierarchical datasets.

READ FULL TEXT
research
04/15/2021

Lorentzian Graph Convolutional Networks

Graph convolutional networks (GCNs) have received considerable research ...
research
03/21/2019

Hydra: A method for strain-minimizing hyperbolic embedding

We introduce hydra (hyperbolic distance recovery and approximation), a n...
research
06/15/2023

Hyperbolic Representation Learning: Revisiting and Advancing

The non-Euclidean geometry of hyperbolic spaces has recently garnered co...
research
12/03/2020

Learning Hyperbolic Representations for Unsupervised 3D Segmentation

There exists a need for unsupervised 3D segmentation on complex volumetr...
research
02/08/2019

A Differentiable Gaussian-like Distribution on Hyperbolic Space for Gradient-Based Learning

Hyperbolic space is a geometry that is known to be well-suited for repre...
research
09/20/2021

Neural Distance Embeddings for Biological Sequences

The development of data-dependent heuristics and representations for bio...
research
07/14/2022

Strain-Minimizing Hyperbolic Network Embeddings with Landmarks

We introduce L-hydra (landmarked hyperbolic distance recovery and approx...

Please sign up or login with your details

Forgot password? Click here to reset