A survey on domain adaptation theory

04/24/2020
by   Ievgen Redko, et al.
49

All famous machine learning algorithms that correspond to both supervised and semi-supervised learning work well only under a common assumption: training and test data follow the same distribution. When the distribution changes, most statistical models must be reconstructed from new collected data that, for some applications, may be costly or impossible to get. Therefore, it became necessary to develop approaches that reduce the need and the effort of obtaining new labeled samples by exploiting data available in related areas and using it further in similar fields. This has given rise to a new machine learning framework called transfer learning: a learning setting inspired by the capability of a human being to extrapolate knowledge across tasks to learn more efficiently. Despite a large amount of different transfer learning scenarios, the main objective of this survey is to provide an overview of the state-of-the-art theoretical results in a specific and arguably the most popular sub-field of transfer learning called domain adaptation. In this sub-field, the data distribution is assumed to change across the training and the test data while the learning task remains the same. We provide a first up-to-date description of existing results related to domain adaptation problem that cover learning bounds based on different statistical learning frameworks.

READ FULL TEXT

page 11

page 14

research
06/08/2021

AdaMatch: A Unified Approach to Semi-Supervised Learning and Domain Adaptation

We extend semi-supervised learning to the problem of domain adaptation t...
research
03/12/2019

Transfer Adaptation Learning: A Decade Survey

The world we see is ever-changing and it always changes with people, thi...
research
12/31/2018

An introduction to domain adaptation and transfer learning

In machine learning, if the training data is an unbiased sample of an un...
research
02/03/2023

Interpretations of Domain Adaptations via Layer Variational Analysis

Transfer learning is known to perform efficiently in many applications e...
research
12/04/2022

Domain Adaptation and Generalization on Functional Medical Images: A Systematic Survey

Machine learning algorithms have revolutionized different fields, includ...
research
05/29/2018

AdapterNet - learning input transformation for domain adaptation

Deep neural networks have demonstrated impressive performance in various...
research
10/26/2022

Is Out-of-Distribution Detection Learnable?

Supervised learning aims to train a classifier under the assumption that...

Please sign up or login with your details

Forgot password? Click here to reset