Hyperdimensional Computing vs. Neural Networks: Comparing Architecture and Learning Process

07/24/2022
by   Dongning Ma, et al.
0

Hyperdimensional Computing (HDC) has obtained abundant attention as an emerging non von Neumann computing paradigm. Inspired by the way human brain functions, HDC leverages high dimensional patterns to perform learning tasks. Compared to neural networks, HDC has shown advantages such as energy efficiency and smaller model size, but sub-par learning capabilities in sophisticated applications. Recently, researchers have observed when combined with neural network components, HDC can achieve better performance than conventional HDC models. This motivates us to explore the deeper insights behind theoretical foundations of HDC, particularly the connection and differences with neural networks. In this paper, we make a comparative study between HDC and neural network to provide a different angle where HDC can be derived from an extremely compact neural network trained upfront. Experimental results show such neural network-derived HDC model can achieve up to 21 conventional and learning-based HDC models respectively. This paper aims to provide more insights and shed lights on future directions for researches on this popular emerging learning scheme.

READ FULL TEXT
research
09/20/2012

The Future of Neural Networks

The paper describes some recent developments in neural networks and disc...
research
09/09/2021

SONIC: A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy-Efficient Deep Learning

Sparse neural networks can greatly facilitate the deployment of neural n...
research
10/01/2021

Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework

Recently, brain-inspired computing models have shown great potential to ...
research
06/20/2017

Optimal modularity and memory capacity of neural networks

The neural network is a powerful computing framework that has been explo...
research
08/26/2020

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

Application-specific optical processors have been considered disruptive ...
research
09/29/2018

Knowledge-guided Semantic Computing Network

It is very useful to integrate human knowledge and experience into tradi...
research
05/26/2021

HDXplore: Automated Blackbox Testing of Brain-Inspired Hyperdimensional Computing

Inspired by the way human brain works, the emerging hyperdimensional com...

Please sign up or login with your details

Forgot password? Click here to reset