Personalized Subgraph Federated Learning

06/21/2022
by   Jinheon Baek, et al.
24

In real-world scenarios, subgraphs of a larger global graph may be distributed across multiple devices or institutions, and only locally accessible due to privacy restrictions, although there may be links between them. Recently proposed subgraph Federated Learning (FL) methods deal with those missing links across private local subgraphs while distributively training Graph Neural Networks (GNNs) on them. However, they have overlooked the inevitable heterogeneity among subgraphs, caused by subgraphs comprising different parts of a global graph. For example, a subgraph may belong to one of the communities within the larger global graph. A naive subgraph FL in such a case will collapse incompatible knowledge from local GNN models trained on heterogeneous graph distributions. To overcome such a limitation, we introduce a new subgraph FL problem, personalized subgraph FL, which focuses on the joint improvement of the interrelated local GNN models rather than learning a single global GNN model, and propose a novel framework, FEDerated Personalized sUBgraph learning (FED-PUB), to tackle it. A crucial challenge in personalized subgraph FL is that the server does not know which subgraph each client has. FED-PUB thus utilizes functional embeddings of the local GNNs using random graphs as inputs to compute similarities between them, and use them to perform weighted averaging for server-side aggregation. Further, it learns a personalized sparse mask at each client to select and update only the subgraph-relevant subset of the aggregated parameters. We validate FED-PUB for its subgraph FL performance on six datasets, considering both non-overlapping and overlapping subgraphs, on which ours largely outperforms relevant baselines.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

06/25/2021

Subgraph Federated Learning with Missing Neighbor Generation

Graphs have been widely used in data mining and machine learning due to ...
10/01/2021

Personalized Retrogress-Resilient Framework for Real-World Medical Federated Learning

Nowadays, deep learning methods with large-scale datasets can produce cl...
04/14/2021

FedGraphNN: A Federated Learning System and Benchmark for Graph Neural Networks

Graph Neural Network (GNN) research is rapidly growing thanks to the cap...
02/01/2022

Factorized-FL: Agnostic Personalized Federated Learning with Kernel Factorization Similarity Matching

In real-world federated learning scenarios, participants could have thei...
07/21/2021

Fed-ensemble: Improving Generalization through Model Ensembling in Federated Learning

In this paper we propose Fed-ensemble: a simple approach that bringsmode...
06/11/2022

Soft-mask: Adaptive Substructure Extractions for Graph Neural Networks

For learning graph representations, not all detailed structures within a...
05/24/2021

Fed-NILM: A Federated Learning-based Non-Intrusive Load Monitoring Method for Privacy-Protection

Non-intrusive load monitoring (NILM) is essential for understanding cust...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.