DeepAI
Log In Sign Up

Hyperbolic Deep Neural Networks: A Survey

01/12/2021
by   Wei Peng, et al.
25

Recently, there has been a raising surge of momentum for deep representation learning in hyperbolic spaces due to theirhigh capacity of modeling data like knowledge graphs or synonym hierarchies, possessing hierarchical structure. We refer it ashyperbolic deep neural network in this paper. Such a hyperbolic neural architecture potentially leads to drastically compact models withmuch more physical interpretability than its counterpart in Euclidean space. To stimulate future research, this paper presents acoherent and comprehensive review of the literature around the neural components in the construction of hyperbolic deep neuralnetworks, as well as the generalization of the leading deep approaches to the Hyperbolic space. It also presents current applicationsaround various machine learning tasks on several publicly available datasets, together with insightful observations and identifying openquestions and promising future directions.

READ FULL TEXT
11/08/2022

Hyperbolic Graph Representation Learning: A Tutorial

Graph-structured data are widespread in real-world applications, such as...
09/12/2022

Bending the Future: Autoregressive Modeling of Temporal Knowledge Graphs in Curvature-Variable Hyperbolic Spaces

Recently there is an increasing scholarly interest in time-varying knowl...
04/11/2020

Robust Large-Margin Learning in Hyperbolic Space

Recently, there has been a surge of interest in representation learning ...
05/24/2018

Hyperbolic Attention Networks

We introduce hyperbolic attention networks to endow neural networks with...
12/03/2021

Nested Hyperbolic Spaces for Dimensionality Reduction and Hyperbolic NN Design

Hyperbolic neural networks have been popular in the recent past due to t...
10/31/2020

Domain-specific Knowledge Graphs: A survey

Knowledge Graphs (KGs) have made a qualitative leap and effected a real ...
02/28/2022

Hyperbolic Graph Neural Networks: A Review of Methods and Applications

Graph neural networks generalize conventional neural networks to graph-s...

Code Repositories

hyperlib

Library that contains implementations of machine learning components in the hyperbolic space


view repo