Optimal Resource Allocation for U-Shaped Parallel Split Learning

08/17/2023
by   Song Lyu, et al.
0

Split learning (SL) has emerged as a promising approach for model training without revealing the raw data samples from the data owners. However, traditional SL inevitably leaks label privacy as the tail model (with the last layers) should be placed on the server. To overcome this limitation, one promising solution is to utilize U-shaped architecture to leave both early layers and last layers on the user side. In this paper, we develop a novel parallel U-shaped split learning and devise the optimal resource optimization scheme to improve the performance of edge networks. In the proposed framework, multiple users communicate with an edge server for SL. We analyze the end-to-end delay of each client during the training process and design an efficient resource allocation algorithm, called LSCRA, which finds the optimal computing resource allocation and split layers. Our experimental results show the effectiveness of LSCRA and that U-shaped PSL can achieve a similar performance with other SL baselines while preserving label privacy. Index Terms: U-shaped network, split learning, label privacy, resource allocation, 5G/6G edge networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2023

Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks

The increasingly deeper neural networks hinder the democratization of pr...
research
09/15/2023

A More Secure Split: Enhancing the Security of Privacy-Preserving Split Learning

Split learning (SL) is a new collaborative learning technique that allow...
research
09/19/2023

Love or Hate? Share or Split? Privacy-Preserving Training Using Split Learning and Homomorphic Encryption

Split learning (SL) is a new collaborative learning technique that allow...
research
01/20/2023

Split Ways: Privacy-Preserving Training of Encrypted Data Using Split Learning

Split Learning (SL) is a new collaborative learning technique that allow...
research
08/13/2021

Spatio-Temporal Split Learning

This paper proposes a novel split learning framework with multiple end-s...
research
10/09/2022

Privacy-preserving Intelligent Resource Allocation for Federated Edge Learning in Quantum Internet

Federated edge learning (FEL) is a promising paradigm of distributed mac...
research
05/23/2019

Accelerating DNN Training in Wireless Federated Edge Learning System

Training task in classical machine learning models, such as deep neural ...

Please sign up or login with your details

Forgot password? Click here to reset