Three Approaches for Personalization with Applications to Federated Learning

02/25/2020
by   Yishay Mansour, et al.
32

The standard objective in machine learning is to train a single model for all users. However, in many learning scenarios, such as cloud computing and federated learning, it is possible to learn one personalized model per user. In this work, we present a systematic learning-theoretic study of personalization. We propose and analyze three approaches: user clustering, data interpolation, and model interpolation. For all three approaches, we provide learning-theoretic guarantees and efficient algorithms for which we also demonstrate the performance empirically. All of our algorithms are model agnostic and work for any hypothesis class.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2019

Agnostic Federated Learning

A key learning scenario in large-scale applications is that of federated...
research
03/24/2021

Opportunistic Federated Learning: An Exploration of Egocentric Collaboration for Pervasive Computing Applications

Pervasive computing applications commonly involve user's personal smartp...
research
11/10/2021

Linear Speedup in Personalized Collaborative Learning

Personalization in federated learning can improve the accuracy of a mode...
research
07/23/2019

A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection

Federated learning has been a hot research area in enabling the collabor...
research
10/14/2022

A Primal-Dual Algorithm for Hybrid Federated Learning

Very few methods for hybrid federated learning, where clients only hold ...
research
08/04/2021

Personalized Federated Learning with Clustering: Non-IID Heart Rate Variability Data Application

While machine learning techniques are being applied to various fields fo...
research
01/25/2022

PREVIS – A Combined Machine Learning and Visual Interpolation Approach for Interactive Reverse Engineering in Assembly Quality Control

We present PREVIS, a visual analytics tool, enhancing machine learning p...

Please sign up or login with your details

Forgot password? Click here to reset