FedGL: Federated Graph Learning Framework with Global Self-Supervision

05/07/2021
by   Chuan Chen, et al.
0

Graph data are ubiquitous in the real world. Graph learning (GL) tries to mine and analyze graph data so that valuable information can be discovered. Existing GL methods are designed for centralized scenarios. However, in practical scenarios, graph data are usually distributed in different organizations, i.e., the curse of isolated data islands. To address this problem, we incorporate federated learning into GL and propose a general Federated Graph Learning framework FedGL, which is capable of obtaining a high-quality global graph model while protecting data privacy by discovering the global self-supervision information during the federated training. Concretely, we propose to upload the prediction results and node embeddings to the server for discovering the global pseudo label and global pseudo graph, which are distributed to each client to enrich the training labels and complement the graph structure respectively, thereby improving the quality of each local model. Moreover, the global self-supervision enables the information of each client to flow and share in a privacy-preserving manner, thus alleviating the heterogeneity and utilizing the complementarity of graph data among different clients. Finally, experimental results show that FedGL significantly outperforms baselines on four widely used graph datasets.

READ FULL TEXT
research
08/29/2022

FedEgo: Privacy-preserving Personalized Federated Graph Learning with Ego-graphs

As special information carriers containing both structure and feature in...
research
12/16/2022

FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks

Massively multi-task learning with large language models has recently ma...
research
07/19/2023

Graph Federated Learning Based on the Decentralized Framework

Graph learning has a wide range of applications in many scenarios, which...
research
03/30/2023

Federated Learning Based Multilingual Emoji Prediction In Clean and Attack Scenarios

Federated learning is a growing field in the machine learning community ...
research
10/27/2022

Federated Graph Representation Learning using Self-Supervision

Federated graph representation learning (FedGRL) brings the benefits of ...
research
05/09/2023

Privacy-Preserving Collaborative Chinese Text Recognition with Federated Learning

In Chinese text recognition, to compensate for the insufficient local da...
research
03/28/2022

FedVLN: Privacy-preserving Federated Vision-and-Language Navigation

Data privacy is a central problem for embodied agents that can perceive ...

Please sign up or login with your details

Forgot password? Click here to reset