Kähler Geometry of Quiver Varieties and Machine Learning

01/27/2021
by   George Jeffreys, et al.
0

We develop an algebro-geometric formulation for neural networks in machine learning using the moduli space of framed quiver representations. We find natural Hermitian metrics on the universal bundles over the moduli which are compatible with the GIT quotient construction by the general linear group, and show that their Ricci curvatures give a Kähler metric on the moduli. Moreover, we use toric moment maps to construct activation functions, and prove the universal approximation theorem for the multi-variable activation function constructed from the complex projective space.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2020

The universal approximation theorem for complex-valued neural networks

We generalize the classical universal approximation theorem for neural n...
research
05/25/2023

Embeddings between Barron spaces with higher order activation functions

The approximation properties of infinitely wide shallow neural networks ...
research
01/31/2022

Metric Hypertransformers are Universal Adapted Maps

We introduce a universal class of geometric deep learning models, called...
research
03/25/2022

Qualitative neural network approximation over R and C: Elementary proofs for analytic and polynomial activation

In this article, we prove approximation theorems in classes of deep and ...
research
07/03/2023

Neural Polytopes

We find that simple neural networks with ReLU activation generate polyto...
research
11/07/2020

Universal Activation Function For Machine Learning

This article proposes a Universal Activation Function (UAF) that achieve...
research
10/22/2021

Logical Activation Functions: Logit-space equivalents of Boolean Operators

Neuronal representations within artificial neural networks are commonly ...

Please sign up or login with your details

Forgot password? Click here to reset