A Causal Framework to Unify Common Domain Generalization Approaches

07/13/2023
by   Nevin L. Zhang, et al.
0

Domain generalization (DG) is about learning models that generalize well to new domains that are related to, but different from, the training domain(s). It is a fundamental problem in machine learning and has attracted much attention in recent years. A large number of approaches have been proposed. Different approaches are motivated from different perspectives, making it difficult to gain an overall understanding of the area. In this paper, we propose a causal framework for domain generalization and present an understanding of common DG approaches in the framework. Our work sheds new lights on the following questions: (1) What are the key ideas behind each DG method? (2) Why is it expected to improve generalization to new domains theoretically? (3) How are different DG methods related to each other and what are relative advantages and limitations? By providing a unified perspective on DG, we hope to help researchers better understand the underlying principles and develop more effective approaches for this critical problem in machine learning.

READ FULL TEXT

page 3

page 20

research
03/02/2021

Generalizing to Unseen Domains: A Survey on Domain Generalization

Domain generalization (DG), i.e., out-of-distribution generalization, ha...
research
03/13/2023

Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issues

Data-driven machine learning (ML) is promoted as one potential technolog...
research
09/08/2023

Generalization Bounds: Perspectives from Information Theory and PAC-Bayes

A fundamental question in theoretical machine learning is generalization...
research
09/22/2020

The Relativity of Induction

Lately there has been a lot of discussion about why deep learning algori...
research
04/06/2020

Levels of Analysis for Machine Learning

Machine learning is currently involved in some of the most vigorous deba...
research
03/03/2021

Out of Distribution Generalization in Machine Learning

Machine learning has achieved tremendous success in a variety of domains...
research
07/28/2021

A Reflection on Learning from Data: Epistemology Issues and Limitations

Although learning from data is effective and has achieved significant mi...

Please sign up or login with your details

Forgot password? Click here to reset