Learn to Forget: User-Level Memorization Elimination in Federated Learning

03/24/2020
by   Yang Liu, et al.
69

Federated learning is a decentralized machine learning technique that evokes widespread attention in both the research field and the real-world market. However, the current privacy-preserving federated learning scheme only provides a secure way for the users to contribute their private data but never leaves a way to withdraw the contribution to model update. Such an irreversible setting potentially breaks the regulations about data protection and increases the risk of data extraction. To resolve the problem, this paper describes a novel concept for federated learning, called memorization elimination. Based on the concept, we propose , a federated learning framework that allows the user to eliminate the memorization of its private data in the trained model. Specifically, each user in is deployed with a trainable dummy gradient generator. After steps of training, the generator can produce dummy gradients to stimulate the neurons of a machine learning model to eliminate the memorization of the specific data. Also, we prove that the additional memorization elimination service of does not break the common procedure of federated learning or lower its security.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2019

SecureBoost: A Lossless Federated Learning Framework

The protection of user privacy is an important concern in machine learni...
research
11/08/2019

Revocable Federated Learning: A Benchmark of Federated Forest

A learning federation is composed of multiple participants who use the f...
research
07/21/2020

Incentives for Federated Learning: a Hypothesis Elicitation Approach

Federated learning provides a promising paradigm for collecting machine ...
research
08/29/2020

GRAFFL: Gradient-free Federated Learning of a Bayesian Generative Model

Federated learning platforms are gaining popularity. One of the major be...
research
10/17/2022

Industry-Scale Orchestrated Federated Learning for Drug Discovery

To apply federated learning to drug discovery we developed a novel platf...
research
05/14/2023

Privacy-Preserving Taxi-Demand Prediction Using Federated Learning

Taxi-demand prediction is an important application of machine learning t...
research
02/23/2023

Data-Free Diversity-Based Ensemble Selection For One-Shot Federated Learning in Machine Learning Model Market

The emerging availability of trained machine learning models has put for...

Please sign up or login with your details

Forgot password? Click here to reset