DeepAI AI Chat
Log In Sign Up

Generalization Error Bound for Hyperbolic Ordinal Embedding

by   Atsushi Suzuki, et al.

Hyperbolic ordinal embedding (HOE) represents entities as points in hyperbolic space so that they agree as well as possible with given constraints in the form of entity i is more similar to entity j than to entity k. It has been experimentally shown that HOE can obtain representations of hierarchical data such as a knowledge base and a citation network effectively, owing to hyperbolic space's exponential growth property. However, its theoretical analysis has been limited to ideal noiseless settings, and its generalization error in compensation for hyperbolic space's exponential representation ability has not been guaranteed. The difficulty is that existing generalization error bound derivations for ordinal embedding based on the Gramian matrix do not work in HOE, since hyperbolic space is not inner-product space. In this paper, through our novel characterization of HOE with decomposed Lorentz Gramian matrices, we provide a generalization error bound of HOE for the first time, which is at most exponential with respect to the embedding space's radius. Our comparison between the bounds of HOE and Euclidean ordinal embedding shows that HOE's generalization error is reasonable as a cost for its exponential representation ability.


page 1

page 2

page 3

page 4


Tight and fast generalization error bound of graph embedding in metric space

Recent studies have experimentally shown that we can achieve in non-Eucl...

The Numerical Stability of Hyperbolic Representation Learning

Given the exponential growth of the volume of the ball w.r.t. its radius...

FFHR: Fully and Flexible Hyperbolic Representation for Knowledge Graph Completion

Learning hyperbolic embeddings for knowledge graph (KG) has gained incre...

Geometry of Comparisons

Many data analysis problems can be cast as distance geometry problems in...

Less but Better: Generalization Enhancement of Ordinal Embedding via Distributional Margin

In the absence of prior knowledge, ordinal embedding methods obtain new ...

Reproduction Capabilities of Penalized Hyperbolic-polynomial Splines

This paper investigates two important analytical properties of hyperboli...

Music Recommendations in Hyperbolic Space: An Application of Empirical Bayes and Hierarchical Poincaré Embeddings

Matrix Factorization (MF) is a common method for generating recommendati...