Energy Minimization for Federated Asynchronous Learning on Battery-Powered Mobile Devices via Application Co-running

04/29/2022
by   Cong Wang, et al.
0

Energy is an essential, but often forgotten aspect in large-scale federated systems. As most of the research focuses on tackling computational and statistical heterogeneity from the machine learning algorithms, the impact on the mobile system still remains unclear. In this paper, we design and implement an online optimization framework by connecting asynchronous execution of federated training with application co-running to minimize energy consumption on battery-powered mobile devices. From a series of experiments, we find that co-running the training process in the background with foreground applications gives the system a deep energy discount with negligible performance slowdown. Based on these results, we first study an offline problem assuming all the future occurrences of applications are available, and propose a dynamic programming-based algorithm. Then we propose an online algorithm using the Lyapunov framework to explore the solution space via the energy-staleness trade-off. The extensive experiments demonstrate that the online optimization framework can save over 60 compared to the previous schemes.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 8

page 10

page 11

research
05/25/2020

Towards Efficient Scheduling of Federated Mobile Devices under Computational and Statistical Heterogeneity

Originated from distributed learning, federated learning enables privacy...
research
05/26/2020

Explore Training of Deep Convolutional Neural Networks on Battery-powered Mobile Devices: Design and Application

The fast-growing smart applications on mobile devices leverage pre-train...
research
12/21/2020

To Talk or to Work: Energy Efficient Federated Learning over Mobile Devices via the Weight Quantization and 5G Transmission Co-Design

Federated learning (FL) is a new paradigm for large-scale learning tasks...
research
02/12/2021

Dancing along Battery: Enabling Transformer with Run-time Reconfigurability on Mobile Devices

A pruning-based AutoML framework for run-time reconfigurability, namely ...
research
04/08/2020

Resource Management for Blockchain-enabled Federated Learning: A Deep Reinforcement Learning Approach

Blockchain-enabled Federated Learning (BFL) enables model updates of Fed...
research
09/02/2021

Self-timed Reinforcement Learning using Tsetlin Machine

We present a hardware design for the learning datapath of the Tsetlin ma...
research
12/02/2019

Mobile Energy Requirements of the Upcoming NIST Post-Quantum Cryptography Standards

Standardization of Post-Quantum Cryptography (PQC) was started by NIST i...

Please sign up or login with your details

Forgot password? Click here to reset