Deep Domain Generalization with Feature-norm Network

04/28/2021
by   Mohammad Mahfujur Rahman, et al.
0

In this paper, we tackle the problem of training with multiple source domains with the aim to generalize to new domains at test time without an adaptation step. This is known as domain generalization (DG). Previous works on DG assume identical categories or label space across the source domains. In the case of category shift among the source domains, previous methods on DG are vulnerable to negative transfer due to the large mismatch among label spaces, decreasing the target classification accuracy. To tackle the aforementioned problem, we introduce an end-to-end feature-norm network (FNN) which is robust to negative transfer as it does not need to match the feature distribution among the source domains. We also introduce a collaborative feature-norm network (CFNN) to further improve the generalization capability of FNN. The CFNN matches the predictions of the next most likely categories for each training sample which increases each network's posterior entropy. We apply the proposed FNN and CFNN networks to the problem of DG for image classification tasks and demonstrate significant improvement over the state-of-the-art.

READ FULL TEXT
research
11/19/2018

Unsupervised Domain Adaptation: An Adaptive Feature Norm Approach

Unsupervised domain adaptation aims to mitigate the domain shift when tr...
research
08/03/2022

Adaptive Domain Generalization via Online Disagreement Minimization

Deep neural networks suffer from significant performance deterioration w...
research
08/03/2021

Domain Generalization via Gradient Surgery

In real-life applications, machine learning models often face scenarios ...
research
04/13/2017

Close Yet Distinctive Domain Adaptation

Domain adaptation is transfer learning which aims to generalize a learni...
research
06/16/2022

Domain Generalization via Selective Consistency Regularization for Time Series Classification

Domain generalization methods aim to learn models robust to domain shift...
research
06/01/2021

Adversarially Adaptive Normalization for Single Domain Generalization

Single domain generalization aims to learn a model that performs well on...
research
08/05/2021

Out-of-domain Generalization from a Single Source: A Uncertainty Quantification Approach

We study a worst-case scenario in generalization: Out-of-domain generali...

Please sign up or login with your details

Forgot password? Click here to reset