Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

07/05/2019
by   Jin-Hyun Ahn, et al.
0

Cooperative training methods for distributed machine learning typically assume noiseless and ideal communication channels. This work studies some of the opportunities and challenges arising from the presence of wireless communication links. We specifically consider wireless implementations of Federated Learning (FL) and Federated Distillation (FD), as well as of a novel Hybrid Federated Distillation (HFD) scheme. Both digital implementations based on separate source-channel coding and over-the-air computing implementations based on joint source-channel coding are proposed and evaluated over Gaussian multiple-access channels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2020

Cooperative Learning via Federated Distillation over Fading Channels

Cooperative training methods for distributed machine learning are typica...
research
02/28/2020

Federated Over-the-Air Subspace Learning from Incomplete Data

Federated learning refers to a distributed learning scenario in which us...
research
01/12/2022

Federated AirNet: Hybrid Digital-Analog Neural Network Transmission for Federated Learning

A key issue in federated learning over wireless channels is how to excha...
research
01/16/2019

Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI

Distributed computing platforms typically assume the availability of rel...
research
10/21/2022

When Wireless Hierarchical Federated Learning Meets Physical Layer Security: A Finite Blocklength Approach

In this paper, the wireless hierarchical federated learning (HFL) is rev...
research
08/11/2023

Wireless Federated k-Means Clustering with Non-coherent Over-the-Air Computation

In this study, we propose using an over-the-air computation (OAC) scheme...
research
04/03/2021

Knowledge Distillation For Wireless Edge Learning

In this paper, we propose a framework for predicting frame errors in the...

Please sign up or login with your details

Forgot password? Click here to reset