DeepAI
Log In Sign Up

Generalized Learning Vector Quantization for Classification in Randomized Neural Networks and Hyperdimensional Computing

06/17/2021
by   Cameron Diao, et al.
0

Machine learning algorithms deployed on edge devices must meet certain resource constraints and efficiency requirements. Random Vector Functional Link (RVFL) networks are favored for such applications due to their simple design and training efficiency. We propose a modified RVFL network that avoids computationally expensive matrix operations during training, thus expanding the network's range of potential applications. Our modification replaces the least-squares classifier with the Generalized Learning Vector Quantization (GLVQ) classifier, which only employs simple vector and distance calculations. The GLVQ classifier can also be considered an improvement upon certain classification algorithms popularly used in the area of Hyperdimensional Computing. The proposed approach achieved state-of-the-art accuracy on a collection of datasets from the UCI Machine Learning Repository - higher than previously proposed RVFL networks. We further demonstrate that our approach still achieves high accuracy while severely limited in training iterations (using on average only 21 costs).

READ FULL TEXT
09/19/2019

Density Encoding Enables Resource-Efficient Randomly Connected Neural Networks

The deployment of machine learning algorithms on resource-constrained ed...
06/02/2021

Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

In the supervised learning domain, considering the recent prevalence of ...
07/26/2018

Aggregated Learning: A Vector Quantization Approach to Learning with Neural Networks

We establish an equivalence between information bottleneck (IB) learning...
03/01/2018

Vector Quantization as Sparse Least Square Optimization

Vector quantization aims to form new vectors/matrices with shared values...
02/25/2020

Non-Volatile Memory Array Based Quantization- and Noise-Resilient LSTM Neural Networks

In cloud and edge computing models, it is important that compute devices...
03/12/2022

A Mixed Quantization Network for Computationally Efficient Mobile Inverse Tone Mapping

Recovering a high dynamic range (HDR) image from a single low dynamic ra...
04/19/2020

Classification using Hyperdimensional Computing: A Review

Hyperdimensional (HD) computing is built upon its unique data type refer...