DeepAI AI Chat
Log In Sign Up

Robust Large-Margin Learning in Hyperbolic Space

04/11/2020
by   Melanie Weber, et al.
12

Recently, there has been a surge of interest in representation learning in hyperbolic spaces, driven by their ability to represent hierarchical data with significantly fewer dimensions than standard Euclidean spaces. However, the viability and benefits of hyperbolic spaces for downstream machine learning tasks have received less attention. In this paper, we present, to our knowledge, the first theoretical guarantees for learning a classifier in hyperbolic rather than Euclidean space. Specifically, we consider the problem of learning a large-margin classifier for data possessing a hierarchical structure. Our first contribution is a hyperbolic perceptron algorithm, which provably converges to a separating hyperplane. We then provide an algorithm to efficiently learn a large-margin hyperplane, relying on the careful injection of adversarial examples. Finally, we prove that for hierarchical data that embeds well into hyperbolic space, the low embedding dimension ensures superior guarantees when learning the classifier directly in hyperbolic space.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/01/2018

Large-Margin Classification in Hyperbolic Space

Representing data in hyperbolic space can effectively capture latent hie...
02/14/2023

Horocycle Decision Boundaries for Large Margin Classification in Hyperbolic Space

Hyperbolic spaces have been quite popular in the recent past for represe...
05/02/2023

A Quadtree for Hyperbolic Space

We propose a data structure in d-dimensional hyperbolic space that can b...
01/12/2021

Hyperbolic Deep Neural Networks: A Survey

Recently, there has been a raising surge of momentum for deep representa...
03/07/2022

Provably Accurate and Scalable Linear Classifiers in Hyperbolic Spaces

Many high-dimensional practical data sets have hierarchical structures i...
02/10/2021

Hyperbolic Generative Adversarial Network

Recently, Hyperbolic Spaces in the context of Non-Euclidean Deep Learnin...
04/14/2023

H2TNE: Temporal Heterogeneous Information Network Embedding in Hyperbolic Spaces

Temporal heterogeneous information network (temporal HIN) embedding, aim...