Federated and Generalized Person Re-identification through Domain and Feature Hallucinating

03/05/2022
by   Fengxiang Yang, et al.
0

In this paper, we study the problem of federated domain generalization (FedDG) for person re-identification (re-ID), which aims to learn a generalized model with multiple decentralized labeled source domains. An empirical method (FedAvg) trains local models individually and averages them to obtain the global model for further local fine-tuning or deploying in unseen target domains. One drawback of FedAvg is neglecting the data distributions of other clients during local training, making the local model overfit local data and producing a poorly-generalized global model. To solve this problem, we propose a novel method, called "Domain and Feature Hallucinating (DFH)", to produce diverse features for learning generalized local and global models. Specifically, after each model aggregation process, we share the Domain-level Feature Statistics (DFS) among different clients without violating data privacy. During local training, the DFS are used to synthesize novel domain statistics with the proposed domain hallucinating, which is achieved by re-weighting DFS with random weights. Then, we propose feature hallucinating to diversify local features by scaling and shifting them to the distribution of the obtained novel domain. The synthesized novel features retain the original pair-wise similarities, enabling us to utilize them to optimize the model in a supervised manner. Extensive experiments verify that the proposed DFH can effectively improve the generalization ability of the global model. Our method achieves the state-of-the-art performance for FedDG on four large-scale re-ID benchmarks.

READ FULL TEXT
research
10/21/2021

Decentralised Person Re-Identification with Selective Knowledge Aggregation

Existing person re-identification (Re-ID) methods mostly follow a centra...
research
05/23/2022

Feature-Distribution Perturbation and Calibration for Generalized Person ReID

Person Re-identification (ReID) has been advanced remarkably over the la...
research
06/07/2020

Decentralised Learning from Independent Multi-Domain Labels for Person Re-Identification

Deep learning has been successful for many computer vision tasks due to ...
research
11/22/2017

AlignedReID: Surpassing Human-Level Performance in Person Re-Identification

In this paper, we propose a novel method called AlignedReID that extract...
research
08/07/2023

Part-Aware Transformer for Generalizable Person Re-identification

Domain generalization person re-identification (DG-ReID) aims to train a...
research
05/19/2021

Generalizable Person Re-identification with Relevance-aware Mixture of Experts

Domain generalizable (DG) person re-identification (ReID) is a challengi...
research
08/17/2023

Identity-Seeking Self-Supervised Representation Learning for Generalizable Person Re-identification

This paper aims to learn a domain-generalizable (DG) person re-identific...

Please sign up or login with your details

Forgot password? Click here to reset