Domain Generalization: A Survey

03/03/2021
by   Kaiyang Zhou, et al.
0

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most statistical learning algorithms strongly rely on the i.i.d. assumption while in practice the target data often come from a different distribution than the source data, known as domain shift. Domain generalization (DG) aims to achieve OOD generalization by only using source domain data for model learning. Since first introduced in 2011, research in DG has undergone a decade progress. Ten years of research in this topic have led to a broad spectrum of methodologies, e.g., based on domain alignment, meta-learning, data augmentation, or ensemble learning, just to name a few; and have covered various applications such as object recognition, segmentation, action recognition, and person re-identification. In this paper, for the first time, a comprehensive literature review is provided to summarize the ten-year development in DG. First, we cover the background by giving the problem definitions and discussing how DG is related to other fields like domain adaptation and transfer learning. Second, we conduct a thorough review into existing methods and present a taxonomy based on their methodologies and motivations. Finally, we conclude this survey with potential research directions.

READ FULL TEXT

page 6

page 7

page 11

research
03/02/2021

Generalizing to Unseen Domains: A Survey on Domain Generalization

Domain generalization (DG), i.e., out-of-distribution generalization, ha...
research
09/28/2021

Multimodality in Meta-Learning: A Comprehensive Survey

Meta-learning has gained wide popularity as a training framework that is...
research
02/23/2023

A Comprehensive Survey on Source-free Domain Adaptation

Over the past decade, domain adaptation has become a widely studied bran...
research
05/26/2021

Multiple Domain Experts Collaborative Learning: Multi-Source Domain Generalization For Person Re-Identification

Recent years have witnessed significant progress in person re-identifica...
research
03/13/2023

Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issues

Data-driven machine learning (ML) is promoted as one potential technolog...
research
06/02/2023

Federated Domain Generalization: A Survey

Machine learning typically relies on the assumption that training and te...
research
06/29/2020

Visual Kinship Recognition: A Decade in the Making

Kinship recognition is a challenging problem with many practical applica...

Please sign up or login with your details

Forgot password? Click here to reset