FairVFL: A Fair Vertical Federated Learning Framework with Contrastive Adversarial Learning

06/07/2022
by   Tao Qi, et al.
0

Vertical federated learning (VFL) is a privacy-preserving machine learning paradigm that can learn models from features distributed on different platforms in a privacy-preserving way. Since in real-world applications the data may contain bias on fairness-sensitive features (e.g., gender), VFL models may inherit bias from training data and become unfair for some user groups. However, existing fair ML methods usually rely on the centralized storage of fairness-sensitive features to achieve model fairness, which are usually inapplicable in federated scenarios. In this paper, we propose a fair vertical federated learning framework (FairVFL), which can improve the fairness of VFL models. The core idea of FairVFL is to learn unified and fair representations of samples based on the decentralized feature fields in a privacy-preserving way. Specifically, each platform with fairness-insensitive features first learns local data representations from local features. Then, these local representations are uploaded to a server and aggregated into a unified representation for the target task. In order to learn fair unified representations, we send them to each platform storing fairness-sensitive features and apply adversarial learning to remove bias from the unified representations inherited from the biased data. Moreover, for protecting user privacy, we further propose a contrastive adversarial learning method to remove privacy information from the unified representations in server before sending them to the platforms keeping fairness-sensitive features. Experiments on two real-world datasets validate that our method can effectively improve model fairness with user privacy well-protected.

READ FULL TEXT
research
09/13/2021

FedFair: Training Fair Models In Cross-Silo Federated Learning

Building fair machine learning models becomes more and more important. A...
research
01/23/2023

Accelerating Fair Federated Learning: Adaptive Federated Adam

Federated learning is a distributed and privacy-preserving approach to t...
research
02/10/2022

Game of Privacy: Towards Better Federated Platform Collaboration under Privacy Restriction

Vertical federated learning (VFL) aims to train models from cross-silo d...
research
02/27/2022

Vertical Machine Unlearning: Selectively Removing Sensitive Information From Latent Feature Space

Recently, the enactment of privacy regulations has promoted the rise of ...
research
07/23/2020

FedCTR: Federated Native Ad CTR Prediction with Multi-Platform User Behavior Data

Native ad is a popular type of online advertisement which has similar fo...
research
04/21/2022

FedCL: Federated Contrastive Learning for Privacy-Preserving Recommendation

Contrastive learning is widely used for recommendation model learning, w...
research
09/05/2023

Bias Propagation in Federated Learning

We show that participating in federated learning can be detrimental to g...

Please sign up or login with your details

Forgot password? Click here to reset