AdaMatch: A Unified Approach to Semi-Supervised Learning and Domain Adaptation

06/08/2021
by   David Berthelot, et al.
0

We extend semi-supervised learning to the problem of domain adaptation to learn significantly higher-accuracy models that train on one data distribution and test on a different one. With the goal of generality, we introduce AdaMatch, a method that unifies the tasks of unsupervised domain adaptation (UDA), semi-supervised learning (SSL), and semi-supervised domain adaptation (SSDA). In an extensive experimental study, we compare its behavior with respective state-of-the-art techniques from SSL, SSDA, and UDA on vision classification tasks. We find AdaMatch either matches or significantly exceeds the state-of-the-art in each case using the same hyper-parameters regardless of the dataset or task. For example, AdaMatch nearly doubles the accuracy compared to that of the prior state-of-the-art on the UDA task for DomainNet and even exceeds the accuracy of the prior state-of-the-art obtained with pre-training by 6.4 providing AdaMatch with just one labeled example per class from the target domain (i.e., the SSDA setting), we increase the target accuracy by an additional 6.1

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2020

MiCo: Mixup Co-Training for Semi-Supervised Domain Adaptation

Semi-supervised domain adaptation (SSDA) aims to adapt models from a lab...
research
06/01/2021

Semi-supervised Models are Strong Unsupervised Domain Adaptation Learners

Unsupervised domain adaptation (UDA) and semi-supervised learning (SSL) ...
research
04/24/2020

A survey on domain adaptation theory

All famous machine learning algorithms that correspond to both supervise...
research
07/12/2018

Learning-based Regularization for Cardiac Strain Analysis with Ability for Domain Adaptation

Reliable motion estimation and strain analysis using 3D+time echocardiog...
research
03/21/2019

Multi-Domain Adversarial Learning

Multi-domain learning (MDL) aims at obtaining a model with minimal avera...
research
12/21/2020

Cost-sensitive Semi-supervised Classification for Fraud Applications

This research explores Cost-Sensitive Learning (CSL) in the fraud detect...
research
01/01/2013

Semi-Supervised Domain Adaptation with Non-Parametric Copulas

A new framework based on the theory of copulas is proposed to address se...

Please sign up or login with your details

Forgot password? Click here to reset