Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry

06/09/2018
by   Maximilian Nickel, et al.
0

We are concerned with the discovery of hierarchical relationships from large-scale unstructured similarity scores. For this purpose, we study different models of hyperbolic space and find that learning embeddings in the Lorentz model is substantially more efficient than in the Poincaré-ball model. We show that the proposed approach allows us to learn high-quality embeddings of large taxonomies which yield improvements over Poincaré embeddings, especially in low dimensions. Lastly, we apply our model to discover hierarchies in two real-world datasets: we show that an embedding in hyperbolic space can reveal important aspects of a company's organizational structure as well as reveal historical relationships between language families.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2021

Unit Ball Model for Hierarchical Embeddings in Complex Hyperbolic Space

Learning the representation of data with hierarchical structures in the ...
research
02/03/2019

Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings

We consider the task of inferring is-a relationships from large text cor...
research
09/20/2021

Neural Distance Embeddings for Biological Sequences

The development of data-dependent heuristics and representations for bio...
research
12/04/2018

Hyperbolic Embeddings for Learning Options in Hierarchical Reinforcement Learning

Hierarchical reinforcement learning deals with the problem of breaking d...
research
03/18/2019

Low-rank approximations of hyperbolic embeddings

The hyperbolic manifold is a smooth manifold of negative constant curvat...
research
06/06/2019

Fine-Grained Entity Typing in Hyperbolic Space

How can we represent hierarchical information present in large type inve...
research
08/29/2023

Hyperbolic Code Retrieval: A Novel Approach for Efficient Code Search Using Hyperbolic Space Embeddings

Within the realm of advanced code retrieval, existing methods have prima...

Please sign up or login with your details

Forgot password? Click here to reset