FedScore: A privacy-preserving framework for federated scoring system development

03/01/2023
by   Siqi Li, et al.
1

We propose FedScore, a privacy-preserving federated learning framework for scoring system generation across multiple sites to facilitate cross-institutional collaborations. The FedScore framework includes five modules: federated variable ranking, federated variable transformation, federated score derivation, federated model selection and federated model evaluation. To illustrate usage and assess FedScore's performance, we built a hypothetical global scoring system for mortality prediction within 30 days after a visit to an emergency department using 10 simulated sites divided from a tertiary hospital in Singapore. We employed a pre-existing score generator to construct 10 local scoring systems independently at each site and we also developed a scoring system using centralized data for comparison. We compared the acquired FedScore model's performance with that of other scoring models using the receiver operating characteristic (ROC) analysis. The FedScore model achieved an average area under the curve (AUC) value of 0.763 across all sites, with a standard deviation (SD) of 0.020. We also calculated the average AUC values and SDs for each local model, and the FedScore model showed promising accuracy and stability with a high average AUC value which was closest to the one of the pooled model and SD which was lower than that of most local models. This study demonstrates that FedScore is a privacy-preserving scoring system generator with potentially good generalizability.

READ FULL TEXT

page 20

page 35

research
10/18/2019

Federated Generative Privacy

In this paper, we propose FedGP, a framework for privacy-preserving data...
research
12/13/2020

Privacy-preserving Decentralized Aggregation for Federated Learning

Federated learning is a promising framework for learning over decentrali...
research
02/17/2021

ppAUC: Privacy Preserving Area Under the Curve with Secure 3-Party Computation

Computing an AUC as a performance measure to compare the quality of diff...
research
05/23/2022

Privacy-preserving Data Filtering in Federated Learning Using Influence Approximation

Federated Learning by nature is susceptible to low-quality, corrupted, o...
research
01/16/2020

Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and Domain Adaptation: ABIDE Results

Deep learning models have shown their advantage in many different tasks,...
research
05/09/2023

Turning Privacy-preserving Mechanisms against Federated Learning

Recently, researchers have successfully employed Graph Neural Networks (...
research
07/30/2020

Federated Visualization: A Privacy-preserving Strategy for Decentralized Visualization

We present a novel privacy preservation strategy for decentralized visua...

Please sign up or login with your details

Forgot password? Click here to reset