Federated Compositional Deep AUC Maximization

04/20/2023
by   Xinwen Zhang, et al.
0

Federated learning has attracted increasing attention due to the promise of balancing privacy and large-scale learning; numerous approaches have been proposed. However, most existing approaches focus on problems with balanced data, and prediction performance is far from satisfactory for many real-world applications where the number of samples in different classes is highly imbalanced. To address this challenging problem, we developed a novel federated learning method for imbalanced data by directly optimizing the area under curve (AUC) score. In particular, we formulate the AUC maximization problem as a federated compositional minimax optimization problem, develop a local stochastic compositional gradient descent ascent with momentum algorithm, and provide bounds on the computational and communication complexities of our algorithm. To the best of our knowledge, this is the first work to achieve such favorable theoretical results. Finally, extensive experimental results confirm the efficacy of our method.

READ FULL TEXT

page 6

page 8

research
04/28/2022

On the Convergence of Momentum-Based Algorithms for Federated Stochastic Bilevel Optimization Problems

In this paper, we studied the federated stochastic bilevel optimization ...
research
08/06/2023

Serverless Federated AUPRC Optimization for Multi-Party Collaborative Imbalanced Data Mining

Multi-party collaborative training, such as distributed learning and fed...
research
03/28/2022

AUC Maximization in the Era of Big Data and AI: A Survey

Area under the ROC curve, a.k.a. AUC, is a measure of choice for assessi...
research
11/17/2015

AUC-maximized Deep Convolutional Neural Fields for Sequence Labeling

Deep Convolutional Neural Networks (DCNN) has shown excellent performanc...
research
07/25/2023

Achieving Linear Speedup in Decentralized Stochastic Compositional Minimax Optimization

The stochastic compositional minimax problem has attracted a surge of at...
research
02/09/2021

Federated Deep AUC Maximization for Heterogeneous Data with a Constant Communication Complexity

eep UC (area under the ROC curve) aximization (DAM) has attracted much a...
research
05/04/2022

FEDNEST: Federated Bilevel, Minimax, and Compositional Optimization

Standard federated optimization methods successfully apply to stochastic...

Please sign up or login with your details

Forgot password? Click here to reset