Hyperbolic Deep Neural Networks: A Survey

01/12/2021
by   Wei Peng, et al.
25

Recently, there has been a raising surge of momentum for deep representation learning in hyperbolic spaces due to theirhigh capacity of modeling data like knowledge graphs or synonym hierarchies, possessing hierarchical structure. We refer it ashyperbolic deep neural network in this paper. Such a hyperbolic neural architecture potentially leads to drastically compact models withmuch more physical interpretability than its counterpart in Euclidean space. To stimulate future research, this paper presents acoherent and comprehensive review of the literature around the neural components in the construction of hyperbolic deep neuralnetworks, as well as the generalization of the leading deep approaches to the Hyperbolic space. It also presents current applicationsaround various machine learning tasks on several publicly available datasets, together with insightful observations and identifying openquestions and promising future directions.

READ FULL TEXT
research
11/08/2022

Hyperbolic Graph Representation Learning: A Tutorial

Graph-structured data are widespread in real-world applications, such as...
research
09/12/2022

Bending the Future: Autoregressive Modeling of Temporal Knowledge Graphs in Curvature-Variable Hyperbolic Spaces

Recently there is an increasing scholarly interest in time-varying knowl...
research
04/11/2020

Robust Large-Margin Learning in Hyperbolic Space

Recently, there has been a surge of interest in representation learning ...
research
05/24/2018

Hyperbolic Attention Networks

We introduce hyperbolic attention networks to endow neural networks with...
research
05/11/2023

Hyperbolic Deep Learning in Computer Vision: A Survey

Deep representation learning is a ubiquitous part of modern computer vis...
research
03/28/2023

Hyperbolic Geometry in Computer Vision: A Novel Framework for Convolutional Neural Networks

Real-world visual data exhibit intrinsic hierarchical structures that ca...
research
02/10/2021

Hyperbolic Generative Adversarial Network

Recently, Hyperbolic Spaces in the context of Non-Euclidean Deep Learnin...

Please sign up or login with your details

Forgot password? Click here to reset