Pick up the PACE: Fast and Simple Domain Adaptation via Ensemble Pseudo-Labeling

05/26/2022
by   Christopher Liao, et al.
0

Domain Adaptation (DA) has received widespread attention from deep learning researchers in recent years because of its potential to improve test accuracy with out-of-distribution labeled data. Most state-of-the-art DA algorithms require an extensive amount of hyperparameter tuning and are computationally intensive due to the large batch sizes required. In this work, we propose a fast and simple DA method consisting of three stages: (1) domain alignment by covariance matching, (2) pseudo-labeling, and (3) ensembling. We call this method PACE, for Pseudo-labels, Alignment of Covariances, and Ensembles. PACE is trained on top of fixed features extracted from an ensemble of modern pretrained backbones. PACE exceeds previous state-of-the-art by 5 - 10 % on most benchmark adaptation tasks without training a neural network. PACE reduces training time and hyperparameter tuning time by 82% and 97%, respectively, when compared to state-of-the-art DA methods. Code is released here: https://github.com/Chris210634/PACE-Domain-Adaptation

READ FULL TEXT

page 20

page 21

page 22

page 23

page 24

research
07/30/2019

Temporal Attentive Alignment for Large-Scale Video Domain Adaptation

Although various image-based domain adaptation (DA) techniques have been...
research
04/27/2021

Efficient Pre-trained Features and Recurrent Pseudo-Labeling inUnsupervised Domain Adaptation

Domain adaptation (DA) mitigates the domain shift problem when transferr...
research
04/01/2021

Semi-Supervised Domain Adaptation via Selective Pseudo Labeling and Progressive Self-Training

Domain adaptation (DA) is a representation learning methodology that tra...
research
03/16/2023

3D Masked Autoencoding and Pseudo-labeling for Domain Adaptive Segmentation of Heterogeneous Infant Brain MRI

Robust segmentation of infant brain MRI across multiple ages, modalities...
research
07/29/2019

Artistic Domain Generalisation Methods are Limited by their Deep Representations

The cross-depiction problem refers to the task of recognising visual obj...
research
03/31/2021

DA-DETR: Domain Adaptive Detection Transformer by Hybrid Attention

The prevalent approach in domain adaptive object detection adopts a two-...
research
05/07/2019

CrossTrainer: Practical Domain Adaptation with Loss Reweighting

Domain adaptation provides a powerful set of model training techniques g...

Please sign up or login with your details

Forgot password? Click here to reset