A General Framework for Hypercomplex-valued Extreme Learning Machines

01/15/2021
by   Guilherme Vieira, et al.
7

This paper aims to establish a framework for extreme learning machines (ELMs) on general hypercomplex algebras. Hypercomplex neural networks are machine learning models that feature higher-dimension numbers as parameters, inputs, and outputs. Firstly, we review broad hypercomplex algebras and show a framework to operate in these algebras through real-valued linear algebra operations in a robust manner. We proceed to explore a handful of well-known four-dimensional examples. Then, we propose the hypercomplex-valued ELMs and derive their learning using a hypercomplex-valued least-squares problem. Finally, we compare real and hypercomplex-valued ELM models' performance in an experiment on time-series prediction and another on color image auto-encoding. The computational experiments highlight the excellent performance of hypercomplex-valued ELMs to treat high-dimensional data, including models based on unusual hypercomplex algebras.

READ FULL TEXT

page 14

page 17

page 18

research
09/14/2023

Understanding Vector-Valued Neural Networks and Their Relationship with Real and Hypercomplex-Valued Neural Networks

Despite the many successful applications of deep learning models for mul...
research
01/30/2020

Quaternion-Valued Recurrent Projection Neural Networks on Unit Quaternions

Hypercomplex-valued neural networks, including quaternion-valued neural ...
research
09/19/2019

An Introduction to Quaternion-Valued Recurrent Projection Neural Networks

Hypercomplex-valued neural networks, including quaternion-valued neural ...
research
12/13/2017

Deep Quaternion Networks

The field of deep learning has seen significant advancement in recent ye...
research
04/28/2019

Real numbers, data science and chaos: How to fit any dataset with a single parameter

We show how any dataset of any modality (time-series, images, sound...) ...
research
08/20/2011

Complex-Valued Autoencoders

Autoencoders are unsupervised machine learning circuits whose learning g...
research
09/26/2019

Overparameterized Neural Networks Can Implement Associative Memory

Identifying computational mechanisms for memorization and retrieval is a...

Please sign up or login with your details

Forgot password? Click here to reset