Hyperbolic Entailment Cones for Learning Hierarchical Embeddings

04/03/2018
by   Octavian-Eugen Ganea, et al.
0

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry. Second, we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones. We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces. Moreover, they canonically define the embedding learning process. Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2019

Hyperbolic Disk Embeddings for Directed Acyclic Graphs

Obtaining continuous representations of structural data such as directed...
research
05/23/2018

Hyperbolic Neural Networks

Hyperbolic spaces have recently gained momentum in the context of machin...
research
05/24/2023

Shadow Cones: Unveiling Partial Orders in Hyperbolic Space

Hyperbolic space has been shown to produce superior low-dimensional embe...
research
03/07/2022

Provably Accurate and Scalable Linear Classifiers in Hyperbolic Spaces

Many high-dimensional practical data sets have hierarchical structures i...
research
09/20/2021

Neural Distance Embeddings for Biological Sequences

The development of data-dependent heuristics and representations for bio...
research
09/15/2021

Comparing Euclidean and Hyperbolic Embeddings on the WordNet Nouns Hypernymy Graph

Nickel and Kiela (2017) present a new method for embedding tree nodes in...
research
04/08/2021

Probing BERT in Hyperbolic Spaces

Recently, a variety of probing tasks are proposed to discover linguistic...

Please sign up or login with your details

Forgot password? Click here to reset