Federated Graph Contrastive Learning

07/24/2022
by   Haoran Yang, et al.
0

Graph learning models are critical tools for researchers to explore graph-structured data. To train a capable graph learning model, a conventional method uses sufficient training data to train a graph model on a single device. However, it is prohibitive to do so in real-world scenarios due to privacy concerns. Federated learning provides a feasible solution to address such limitations via introducing various privacy-preserving mechanisms, such as differential privacy on graph edges. Nevertheless, differential privacy in federated graph learning secures the classified information maintained in graphs. It degrades the performances of the graph learning models. In this paper, we investigate how to implement differential privacy on graph edges and observe the performances decreasing in the experiments. We also note that the differential privacy on graph edges introduces noises to perturb graph proximity, which is one of the graph augmentations in graph contrastive learning. Inspired by that, we propose to leverage the advantages of graph contrastive learning to alleviate the performance dropping caused by differential privacy. Extensive experiments are conducted with several representative graph models and widely-used datasets, showing that contrastive learning indeed alleviates the models' performance dropping caused by differential privacy.

READ FULL TEXT

page 1

page 11

page 14

research
08/23/2021

Federated Learning Meets Fairness and Differential Privacy

Deep learning's unprecedented success raises several ethical concerns ra...
research
09/28/2022

Momentum Gradient Descent Federated Learning with Local Differential Privacy

Nowadays, the development of information technology is growing rapidly. ...
research
06/10/2023

Personalized Graph Federated Learning with Differential Privacy

This paper presents a personalized graph federated learning (PGFL) frame...
research
02/28/2021

An Introduction to Johnson-Lindenstrauss Transforms

Johnson–Lindenstrauss Transforms are powerful tools for reducing the dim...
research
10/26/2022

Local Graph-homomorphic Processing for Privatized Distributed Systems

We study the generation of dependent random numbers in a distributed fas...
research
05/25/2023

Private Meeting Summarization Without Performance Loss

Meeting summarization has an enormous business potential, but in additio...
research
01/17/2023

Graph Topology Learning Under Privacy Constraints

Graph learning, which aims to infer the underlying topology behind high ...

Please sign up or login with your details

Forgot password? Click here to reset