HDTorch: Accelerating Hyperdimensional Computing with GP-GPUs for Design Space Exploration

06/09/2022
by   William Andrew Simon, et al.
0

HyperDimensional Computing (HDC) as a machine learning paradigm is highly interesting for applications involving continuous, semi-supervised learning for long-term monitoring. However, its accuracy is not yet on par with other Machine Learning (ML) approaches. Frameworks enabling fast design space exploration to find practical algorithms are necessary to make HD computing competitive with other ML techniques. To this end, we introduce HDTorch, an open-source, PyTorch-based HDC library with CUDA extensions for hypervector operations. We demonstrate HDTorch's utility by analyzing four HDC benchmark datasets in terms of accuracy, runtime, and memory consumption, utilizing both classical and online HD training methodologies. We demonstrate average (training)/inference speedups of (111x/68x)/87x for classical/online HD, respectively. Moreover, we analyze the effects of varying hyperparameters on runtime and accuracy. Finally, we demonstrate how HDTorch enables exploration of HDC strategies applied to large, real-world datasets. We perform the first-ever HD training and inference analysis of the entirety of the CHB-MIT EEG epilepsy database. Results show that the typical approach of training on a subset of the data does not necessarily generalize to the entire dataset, an important factor when developing future HD models for medical wearable devices.

READ FULL TEXT

page 1

page 6

page 7

research
03/24/2019

TonY: An Orchestrator for Distributed Machine Learning Jobs

Training machine learning (ML) models on large datasets requires conside...
research
06/15/2023

ArchGym: An Open-Source Gymnasium for Machine Learning Assisted Architecture Design

Machine learning is a prevalent approach to tame the complexity of desig...
research
02/22/2017

When Lempel-Ziv-Welch Meets Machine Learning: A Case Study of Accelerating Machine Learning using Coding

In this paper we study the use of coding techniques to accelerate machin...
research
05/23/2022

PyRelationAL: A Library for Active Learning Research and Development

In constrained real-world scenarios where it is challenging or costly to...
research
07/29/2020

Accelerating Multi-attribute Unsupervised Seismic Facies Analysis With RAPIDS

Classification of seismic facies is done by clustering seismic data samp...
research
10/28/2022

Estimating oil recovery factor using machine learning: Applications of XGBoost classification

In petroleum engineering, it is essential to determine the ultimate reco...
research
03/16/2018

Snap Machine Learning

We describe an efficient, scalable machine learning library that enables...

Please sign up or login with your details

Forgot password? Click here to reset