AirMixML: Over-the-Air Data Mixup for Inherently Privacy-Preserving Edge Machine Learning

05/02/2021
by   Yusuke Koda, et al.
123

Wireless channels can be inherently privacy-preserving by distorting the received signals due to channel noise, and superpositioning multiple signals over-the-air. By harnessing these natural distortions and superpositions by wireless channels, we propose a novel privacy-preserving machine learning (ML) framework at the network edge, coined over-the-air mixup ML (AirMixML). In AirMixML, multiple workers transmit analog-modulated signals of their private data samples to an edge server who trains an ML model using the received noisy-and superpositioned samples. AirMixML coincides with model training using mixup data augmentation achieving comparable accuracy to that with raw data samples. From a privacy perspective, AirMixML is a differentially private (DP) mechanism limiting the disclosure of each worker's private sample information at the server, while the worker's transmit power determines the privacy disclosure level. To this end, we develop a fractional channel-inversion power control (PC) method, α-Dirichlet mixup PC (DirMix(α)-PC), wherein for a given global power scaling factor after channel inversion, each worker's local power contribution to the superpositioned signal is controlled by the Dirichlet dispersion ratio α. Mathematically, we derive a closed-form expression clarifying the relationship between the local and global PC factors to guarantee a target DP level. By simulations, we provide DirMix(α)-PC design guidelines to improve accuracy, privacy, and energy-efficiency. Finally, AirMixML with DirMix(α)-PC is shown to achieve reasonable accuracy compared to a privacy-violating baseline with neither superposition nor PC.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
06/19/2023

Differentially Private Over-the-Air Federated Learning Over MIMO Fading Channels

Federated learning (FL) enables edge devices to collaboratively train ma...
research
04/02/2022

Production of Categorical Data Verifying Differential Privacy: Conception and Applications to Machine Learning

Private and public organizations regularly collect and analyze digitaliz...
research
04/15/2023

Communication and Energy Efficient Wireless Federated Learning with Intrinsic Privacy

Federated Learning (FL) is a collaborative learning framework that enabl...
research
07/03/2020

Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning

Wireless connectivity is instrumental in enabling scalable federated lea...
research
07/15/2019

Multi-hop Federated Private Data Augmentation with Sample Compression

On-device machine learning (ML) has brought about the accessibility to a...
research
03/07/2019

Impact of Social Learning on Privacy-Preserving Data Collection

We study a model where a data collector obtains data from users through ...
research
02/26/2021

Federated Edge Learning with Misaligned Over-The-Air Computation

Over-the-air computation (OAC) is a promising technique to realize fast ...

Please sign up or login with your details

Forgot password? Click here to reset