Resource-Efficient Federated Hyperdimensional Computing

06/02/2023
by   Nikita Zeulin, et al.
0

In conventional federated hyperdimensional computing (HDC), training larger models usually results in higher predictive performance but also requires more computational, communication, and energy resources. If the system resources are limited, one may have to sacrifice the predictive performance by reducing the size of the HDC model. The proposed resource-efficient federated hyperdimensional computing (RE-FHDC) framework alleviates such constraints by training multiple smaller independent HDC sub-models and refining the concatenated HDC model using the proposed dropout-inspired procedure. Our numerical comparison demonstrates that the proposed framework achieves a comparable or higher predictive performance while consuming less computational and wireless resources than the baseline federated HDC implementation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/11/2023

Towards Federated Learning Under Resource Constraints via Layer-wise Training and Depth Dropout

Large machine learning models trained on diverse data have recently seen...
research
10/07/2021

Enabling On-Device Training of Speech Recognition Models with Federated Dropout

Federated learning can be used to train machine learning models on the e...
research
11/14/2022

Federated Learning Framework in Fogbus2-based Edge Computing Environments

Federated learning refers to conducting training on multiple distributed...
research
11/03/2022

Federated Hypergradient Descent

In this work, we explore combining automatic hyperparameter tuning and o...
research
11/03/2017

Implicit Weight Uncertainty in Neural Networks

We interpret HyperNetworks within the framework of variational inference...
research
09/08/2022

FADE: Enabling Large-Scale Federated Adversarial Training on Resource-Constrained Edge Devices

Adversarial Training (AT) has been proven to be an effective method of i...
research
01/13/2022

Towards a Data Privacy-Predictive Performance Trade-off

Machine learning is increasingly used in the most diverse applications a...

Please sign up or login with your details

Forgot password? Click here to reset