OL4EL: Online Learning for Edge-cloud Collaborative Learning on Heterogeneous Edges with Resource Constraints

04/22/2020
by   Qing Han, et al.
4

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or edges) pose great challenges on distributed ML and formulate a new paradigm of Edge Learning (i.e. edge-cloud collaborative machine learning). In this article, we propose a novel framework of 'learning to learn' for effective Edge Learning (EL) on heterogeneous edges with resource constraints. We first model the dynamic determination of collaboration strategy (i.e. the allocation of local iterations at edge servers and global aggregations on the Cloud during collaborative learning process) as an online optimization problem to achieve the tradeoff between the performance of EL and the resource consumption of edge servers. Then, we propose an Online Learning for EL (OL4EL) framework based on the budget-limited multi-armed bandit model. OL4EL supports both synchronous and asynchronous learning patterns, and can be used for both supervised and unsupervised learning tasks. To evaluate the performance of OL4EL, we conducted both real-world testbed experiments and extensive simulations based on docker containers, where both Support Vector Machine and K-means were considered as use cases. Experimental results demonstrate that OL4EL significantly outperforms state-of-the-art EL and other collaborative ML approaches in terms of the trade-off between learning performance and resource consumption.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

research
05/04/2020

CDC: Classification Driven Compression for Bandwidth Efficient Edge-Cloud Collaborative Deep Learning

The emerging edge-cloud collaborative Deep Learning (DL) paradigm aims a...
research
05/26/2023

A Framework for Incentivized Collaborative Learning

Collaborations among various entities, such as companies, research labs,...
research
04/02/2020

Cocktail: Cost-efficient and Data Skew-aware Online In-Network Distributed Machine Learning for Intelligent 5G and Beyond

To facilitate the emerging applications in the 5G networks and beyond, m...
research
02/01/2023

Task Placement and Resource Allocation for Edge Machine Learning: A GNN-based Multi-Agent Reinforcement Learning Paradigm

Machine learning (ML) tasks are one of the major workloads in today's ed...
research
04/27/2022

Edge-PRUNE: Flexible Distributed Deep Learning Inference

Collaborative deep learning inference between low-resource endpoint devi...
research
07/02/2023

Collaborative Policy Learning for Dynamic Scheduling Tasks in Cloud-Edge-Terminal IoT Networks Using Federated Reinforcement Learning

In this paper, we examine cloud-edge-terminal IoT networks, where edges ...
research
09/16/2019

VeriML: Enabling Integrity Assurances and Fair Payments for Machine Learning as a Service

Machine Learning as a Service (MLaaS) allows clients with limited resour...

Please sign up or login with your details

Forgot password? Click here to reset