Hybrid Federated Learning: Algorithms and Implementation

12/22/2020
by   Xinwei Zhang, et al.
32

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid settings. Despite the fact that many works have been developed for the first two approaches, the hybrid FL setting (which deals with partially overlapped feature space and sample space) remains less explored, though this setting is extremely important in practice. In this paper, we first set up a new model-matching-based problem formulation for hybrid FL, then propose an efficient algorithm that can collaboratively train the global and local models to deal with full and partial featured data. We conduct numerical experiments on the multi-view ModelNet40 data set to validate the performance of the proposed algorithm. To the best of our knowledge, this is the first formulation and algorithm developed for the hybrid FL.

READ FULL TEXT
research
12/02/2021

How global observation works in Federated Learning: Integrating vertical training into Horizontal Federated Learning

Federated learning (FL) has recently emerged as a transformative paradig...
research
12/02/2022

Faster Adaptive Federated Learning

Federated learning has attracted increasing attention with the emergence...
research
03/08/2023

Distributed and Deep Vertical Federated Learning with Big Data

In recent years, data are typically distributed in multiple organization...
research
06/12/2022

Federated Learning on Riemannian Manifolds

Federated learning (FL) has found many important applications in smart-p...
research
01/25/2021

Failure Prediction in Production Line Based on Federated Learning: An Empirical Study

Data protection across organizations is limiting the application of cent...
research
02/15/2023

Bayesian Federated Inference for Statistical Models

Identifying predictive factors via multivariable statistical analysis is...
research
10/05/2022

FedMT: Federated Learning with Mixed-type Labels

In federated learning (FL), classifiers (e.g., deep networks) are traine...

Please sign up or login with your details

Forgot password? Click here to reset