Grassmannian Learning: Embedding Geometry Awareness in Shallow and Deep Learning

08/07/2018
by   Jiayao Zhang, et al.
4

Modern machine learning algorithms have been adopted in a range of signal-processing applications spanning computer vision, natural language processing, and artificial intelligence. Many relevant problems involve subspace-structured features, orthogonality constrained or low-rank constrained objective functions, or subspace distances. These mathematical characteristics are expressed naturally using the Grassmann manifold. Unfortunately, this fact is not yet explored in many traditional learning algorithms. In the last few years, there have been growing interests in studying Grassmann manifold to tackle new learning problems. Such attempts have been reassured by substantial performance improvements in both classic learning and learning using deep neural networks. We term the former as shallow and the latter deep Grassmannian learning. The aim of this paper is to introduce the emerging area of Grassmannian learning by surveying common mathematical problems and primary solution approaches, and overviewing various applications. We hope to inspire practitioners in different fields to adopt the powerful tool of Grassmannian learning in their research.

READ FULL TEXT

page 8

page 9

page 10

page 12

page 13

page 16

research
04/11/2018

Deep Learning For Computer Vision Tasks: A review

Deep learning has recently become one of the most popular sub-fields of ...
research
03/25/2022

Deep Learning and Artificial General Intelligence: Still a Long Way to Go

In recent years, deep learning using neural network architecture, i.e. d...
research
11/24/2016

Geometric deep learning: going beyond Euclidean data

Many scientific fields study data with an underlying structure that is a...
research
03/18/2019

Low-rank approximations of hyperbolic embeddings

The hyperbolic manifold is a smooth manifold of negative constant curvat...
research
03/09/2018

Construction of neural networks for realization of localized deep learning

The subject of deep learning has recently attracted users of machine lea...
research
12/02/2020

DecisiveNets: Training Deep Associative Memories to Solve Complex Machine Learning Problems

Learning deep representations to solve complex machine learning tasks ha...
research
07/04/2021

A precise bare simulation approach to the minimization of some distances. Foundations

In information theory – as well as in the adjacent fields of statistics,...

Please sign up or login with your details

Forgot password? Click here to reset