Feature Stylization and Domain-aware Contrastive Learning for Domain Generalization

08/19/2021
by   Seogkyu Jeon, et al.
0

Domain generalization aims to enhance the model robustness against domain shift without accessing the target domain. Since the available source domains for training are limited, recent approaches focus on generating samples of novel domains. Nevertheless, they either struggle with the optimization problem when synthesizing abundant domains or cause the distortion of class semantics. To these ends, we propose a novel domain generalization framework where feature statistics are utilized for stylizing original features to ones with novel domain properties. To preserve class information during stylization, we first decompose features into high and low frequency components. Afterward, we stylize the low frequency components with the novel domain styles sampled from the manipulated statistics, while preserving the shape cues in high frequency ones. As the final step, we re-merge both components to synthesize novel domain features. To enhance domain robustness, we utilize the stylized features to maintain the model consistency in terms of features as well as outputs. We achieve the feature consistency with the proposed domain-aware supervised contrastive loss, which ensures domain invariance while increasing class discriminability. Experimental results demonstrate the effectiveness of the proposed feature stylization and the domain-aware contrastive loss. Through quantitative comparisons, we verify the lead of our method upon existing state-of-the-art methods on two benchmarks, PACS and Office-Home.

READ FULL TEXT
research
07/24/2023

Cross Contrastive Feature Perturbation for Domain Generalization

Domain generalization (DG) aims to learn a robust model from source doma...
research
01/20/2022

Domain Generalization via Frequency-based Feature Disentanglement and Interaction

Data out-of-distribution is a meta-challenge for all statistical learnin...
research
03/23/2022

Deep Frequency Filtering for Domain Generalization

Improving the generalization capability of Deep Neural Networks (DNNs) i...
research
03/24/2022

FAMLP: A Frequency-Aware MLP-Like Architecture For Domain Generalization

MLP-like models built entirely upon multi-layer perceptrons have recentl...
research
02/05/2023

Aggregation of Disentanglement: Reconsidering Domain Variations in Domain Generalization

Domain Generalization (DG) is a fundamental challenge for machine learni...
research
03/01/2021

Domain Generalization via Inference-time Label-Preserving Target Projections

Generalization of machine learning models trained on a set of source dom...
research
08/31/2021

Self-balanced Learning For Domain Generalization

Domain generalization aims to learn a prediction model on multi-domain s...

Please sign up or login with your details

Forgot password? Click here to reset