Non-constant bounded holomorphic functions of hyperbolic numbers - Candidates for hyperbolic activation functions

06/07/2013
by   Eckhard Hitzer, et al.
0

The Liouville theorem states that bounded holomorphic complex functions are necessarily constant. Holomorphic functions fulfill the socalled Cauchy-Riemann (CR) conditions. The CR conditions mean that a complex z-derivative is independent of the direction. Holomorphic functions are ideal for activation functions of complex neural networks, but the Liouville theorem makes them useless. Yet recently the use of hyperbolic numbers, lead to the construction of hyperbolic number neural networks. We will describe the Cauchy-Riemann conditions for hyperbolic numbers and show that there exists a new interesting type of bounded holomorphic functions of hyperbolic numbers, which are not constant. We give examples of such functions. They therefore substantially expand the available candidates for holomorphic activation functions for hyperbolic number neural networks. Keywords: Hyperbolic numbers, Liouville theorem, Cauchy-Riemann conditions, bounded holomorphic functions

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2019

A Broad Class of Discrete-Time Hypercomplex-Valued Hopfield Neural Networks

In this paper, we address the stability of a broad class of discrete-tim...
research
01/17/2020

Approximating Activation Functions

ReLU is widely seen as the default choice for activation functions in ne...
research
11/17/2022

Multilayer Perceptron-based Surrogate Models for Finite Element Analysis

Many Partial Differential Equations (PDEs) do not have analytical soluti...
research
01/04/2023

Implementation of hyperbolic complex numbers in Julia language

Background: Hyperbolic complex numbers are used in the description of hy...
research
06/28/2023

Empirical Loss Landscape Analysis of Neural Network Activation Functions

Activation functions play a significant role in neural network design by...
research
06/22/2022

Consistency of Neural Networks with Regularization

Neural networks have attracted a lot of attention due to its success in ...
research
02/14/2022

Reproduction Capabilities of Penalized Hyperbolic-polynomial Splines

This paper investigates two important analytical properties of hyperboli...

Please sign up or login with your details

Forgot password? Click here to reset