Correlation Alignment for Unsupervised Domain Adaptation

12/06/2016
by   Baochen Sun, et al.
0

In this chapter, we present CORrelation ALignment (CORAL), a simple yet effective method for unsupervised domain adaptation. CORAL minimizes domain shift by aligning the second-order statistics of source and target distributions, without requiring any target labels. In contrast to subspace manifold methods, it aligns the original feature distributions of the source and target domains, rather than the bases of lower-dimensional subspaces. It is also much simpler than other distribution matching methods. CORAL performs remarkably well in extensive evaluations on standard benchmark datasets. We first describe a solution that applies a linear transformation to source features to align them with target features before classifier training. For linear classifiers, we propose to equivalently apply CORAL to the classifier weights, leading to added efficiency when the number of classifiers is small but the number and dimensionality of target examples are very high. The resulting CORAL Linear Discriminant Analysis (CORAL-LDA) outperforms LDA by a large margin on standard domain adaptation benchmarks. Finally, we extend CORAL to learn a nonlinear transformation that aligns correlations of layer activations in deep neural networks (DNNs). The resulting Deep CORAL approach works seamlessly with DNNs and achieves state-of-the-art performance on standard benchmark datasets. Our code is available at: <https://github.com/VisionLearningGroup/CORAL>

READ FULL TEXT

page 9

page 19

research
07/06/2016

Deep CORAL: Correlation Alignment for Deep Domain Adaptation

Deep neural networks are able to learn powerful representations from lar...
research
11/17/2015

Return of Frustratingly Easy Domain Adaptation

Unlike human learning, machine learning often fails to handle changes be...
research
11/12/2018

Exploiting Local Feature Patterns for Unsupervised Domain Adaptation

Unsupervised domain adaptation methods aim to alleviate performance degr...
research
12/27/2019

HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptation

Minimizing the discrepancy of feature distributions between different do...
research
04/28/2021

Randomized Histogram Matching: A Simple Augmentation for Unsupervised Domain Adaptation in Overhead Imagery

Modern deep neural networks (DNNs) achieve highly accurate results for m...
research
09/18/2014

Subspace Alignment For Domain Adaptation

In this paper, we introduce a new domain adaptation (DA) algorithm where...
research
07/29/2022

StyleAM: Perception-Oriented Unsupervised Domain Adaption for Non-reference Image Quality Assessment

Deep neural networks (DNNs) have shown great potential in non-reference ...

Please sign up or login with your details

Forgot password? Click here to reset