Fishing for User Data in Large-Batch Federated Learning via Gradient Magnification

02/01/2022
by   Yuxin Wen, et al.
0

Federated learning (FL) has rapidly risen in popularity due to its promise of privacy and efficiency. Previous works have exposed privacy vulnerabilities in the FL pipeline by recovering user data from gradient updates. However, existing attacks fail to address realistic settings because they either 1) require a `toy' settings with very small batch sizes, or 2) require unrealistic and conspicuous architecture modifications. We introduce a new strategy that dramatically elevates existing attacks to operate on batches of arbitrarily large size, and without architectural modifications. Our model-agnostic strategy only requires modifications to the model parameters sent to the user, which is a realistic threat model in many scenarios. We demonstrate the strategy in challenging large-scale settings, obtaining high-fidelity data extraction in both cross-device and cross-silo federated learning.

READ FULL TEXT

page 2

page 10

page 19

page 20

page 21

research
10/25/2021

Robbing the Fed: Directly Obtaining Private Data in Federated Learning with Modified Models

Federated learning has quickly gained popularity with its promises of in...
research
01/29/2022

Decepticons: Corrupted Transformers Breach Privacy in Federated Learning for Language Models

A central tenet of Federated learning (FL), which trains models without ...
research
03/01/2021

Towards Personalized Federated Learning

As artificial intelligence (AI)-empowered applications become widespread...
research
08/10/2023

FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attacks

Federated learning (FL) is revolutionizing how we learn from data. With ...
research
02/05/2021

Federated Reconstruction: Partially Local Federated Learning

Personalization methods in federated learning aim to balance the benefit...
research
10/06/2022

CANIFE: Crafting Canaries for Empirical Privacy Measurement in Federated Learning

Federated Learning (FL) is a setting for training machine learning model...
research
01/22/2020

Stratified cross-validation for unbiased and privacy-preserving federated learning

Large-scale collections of electronic records constitutes both an opport...

Please sign up or login with your details

Forgot password? Click here to reset