Overlaying Spaces and Practical Applicability of Complex Geometries

07/05/2020
by   Kirill Shevkunov, et al.
0

Recently, non-Euclidean spaces became popular for embedding structured data. Following hyperbolic and spherical spaces, more general product spaces have been proposed. However, searching for the best configuration of a product space is a resource-intensive procedure, which reduces the practical applicability of the idea. We introduce a novel concept of overlaying spaces that does not have the problem of configuration search and outperforms the competitors in structured data embedding tasks, when the aim is to preserve all distances. On the other hand, for local loss functions (e.g., for ranking losses), the dot-product similarity, which is often overlooked in graph embedding literature since it cannot be converted to a metric, outperforms all metric spaces. We discuss advantages of the dot product over proper metric spaces.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2023

Gromov-Hausdorff Distances for Comparing Product Manifolds of Model Spaces

Recent studies propose enhancing machine learning models by aligning the...
research
02/17/2021

Switch Spaces: Learning Product Spaces with Sparse Gating

Learning embedding spaces of suitable geometry is critical for represent...
research
07/10/2023

Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold

In graph representation learning, it is important that the complex geome...
research
08/10/2022

Neural Embedding: Learning the Embedding of the Manifold of Physics Data

In this paper, we present a method of embedding physics data manifolds w...
research
04/08/2021

Advances in Metric Ramsey Theory and its Applications

Metric Ramsey theory is concerned with finding large well-structured sub...
research
10/08/2019

Beyond Vector Spaces: Compact Data Representationas Differentiable Weighted Graphs

Learning useful representations is a key ingredient to the success of mo...
research
10/08/2019

Beyond Vector Spaces: Compact Data Representation as Differentiable Weighted Graphs

Learning useful representations is a key ingredient to the success of mo...

Please sign up or login with your details

Forgot password? Click here to reset