Private Federated Learning in Gboard

06/26/2023
by   Yuanbo Zhang, et al.
0

This white paper describes recent advances in Gboard(Google Keyboard)'s use of federated learning, DP-Follow-the-Regularized-Leader (DP-FTRL) algorithm, and secure aggregation techniques to train machine learning (ML) models for suggestion, prediction and correction intelligence from many users' typing data. Gboard's investment in those privacy technologies allows users' typing data to be processed locally on device, to be aggregated as early as possible, and to have strong anonymization and differential privacy where possible. Technical strategies and practices have been established to allow ML models to be trained and deployed with meaningfully formal DP guarantees and high utility. The paper also looks ahead to how technologies such as trusted execution environments may be used to further improve the privacy and security of Gboard's ML models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2023

Federated Learning of Gboard Language Models with Differential Privacy

We train language models (LMs) with federated learning (FL) and differen...
research
05/19/2022

Differential Privacy: What is all the noise about?

Differential Privacy (DP) is a formal definition of privacy that provide...
research
07/14/2023

Population Expansion for Training Language Models with Private Federated Learning

Federated learning (FL) combined with differential privacy (DP) offers m...
research
11/20/2022

Learning to Generate Image Embeddings with User-level Differential Privacy

Small on-device models have been successfully trained with user-level di...
research
05/09/2022

Protecting Data from all Parties: Combining FHE and DP in Federated Learning

This paper tackles the problem of ensuring training data privacy in a fe...
research
06/16/2022

BlindFL: Vertical Federated Machine Learning without Peeking into Your Data

Due to the rising concerns on privacy protection, how to build machine l...
research
02/09/2023

Distributed Learning with Curious and Adversarial Machines

The ubiquity of distributed machine learning (ML) in sensitive public do...

Please sign up or login with your details

Forgot password? Click here to reset