High–Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

01/14/2020
by   Alexander N. Gorban, et al.
38

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states: many problems become exponentially difficult in high dimensions. Recently, the other side of the coin, the "blessing of dimensionality", has attracted much attention. It turns out that generic high-dimensional datasets exhibit fairly simple geometric properties. Thus, there is a fundamental tradeoff between complexity and simplicity in high dimensional spaces. Here we present a brief explanatory review of recent ideas, results and hypotheses about the blessing of dimensionality and related simplifying effects relevant to machine learning and neuroscience.

READ FULL TEXT

page 3

page 5

page 6

page 7

page 9

page 15

page 16

page 17

research
06/27/2019

Symphony of high-dimensional brain

This paper is the final part of the scientific discussion organised by t...
research
09/20/2018

The unreasonable effectiveness of small neural ensembles in high-dimensional brain

Despite the widely-spread consensus on the brain complexity, sprouts of ...
research
05/17/2020

High-dimensional Convolutional Networks for Geometric Pattern Recognition

Many problems in science and engineering can be formulated in terms of g...
research
09/04/2016

High Dimensional Human Guided Machine Learning

Have you ever looked at a machine learning classification model and thou...
research
11/08/2018

Intrinsic Geometric Vulnerability of High-Dimensional Artificial Intelligence

The success of modern Artificial Intelligence (AI) technologies depends ...
research
07/10/2017

Learning in High-Dimensional Multimedia Data: The State of the Art

During the last decade, the deluge of multimedia data has impacted a wid...
research
01/23/2021

ReliefE: Feature Ranking in High-dimensional Spaces via Manifold Embeddings

Feature ranking has been widely adopted in machine learning applications...

Please sign up or login with your details

Forgot password? Click here to reset