Bures Joint Distribution Alignment with Dynamic Margin for Unsupervised Domain Adaptation

by   Yong-Hui Liu, et al.

Unsupervised domain adaptation (UDA) is one of the prominent tasks of transfer learning, and it provides an effective approach to mitigate the distribution shift between the labeled source domain and the unlabeled target domain. Prior works mainly focus on aligning the marginal distributions or the estimated class-conditional distributions. However, the joint dependency among the feature and the label is crucial for the adaptation task and is not fully exploited. To address this problem, we propose the Bures Joint Distribution Alignment (BJDA) algorithm which directly models the joint distribution shift based on the optimal transport theory in the infinite-dimensional kernel spaces. Specifically, we propose a novel alignment loss term that minimizes the kernel Bures-Wasserstein distance between the joint distributions. Technically, BJDA can effectively capture the nonlinear structures underlying the data. In addition, we introduce a dynamic margin in contrastive learning phase to flexibly characterize the class separability and improve the discriminative ability of representations. It also avoids the cross-validation procedure to determine the margin parameter in traditional triplet loss based methods. Extensive experiments show that BJDA is very effective for the UDA tasks, as it outperforms state-of-the-art algorithms in most experimental settings. In particular, BJDA improves the average accuracy of UDA tasks by 2.8 Adaptiope, 1.4


page 4

page 5

page 6

page 8

page 9

page 10

page 12

page 14


Deep Least Squares Alignment for Unsupervised Domain Adaptation

Unsupervised domain adaptation leverages rich information from a labeled...

Joint Distribution Alignment via Adversarial Learning for Domain Adaptive Object Detection

Unsupervised domain adaptive object detection aims to adapt a well-train...

Towards Self-similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation

Recent advances in unsupervised domain adaptation mainly focus on learni...

Correlated Adversarial Joint Discrepancy Adaptation Network

Domain adaptation aims to mitigate the domain shift problem when transfe...

Unsupervised Domain Adaptation via Regularized Conditional Alignment

We propose a method for unsupervised domain adaptation that trains a sha...

A General Upper Bound for Unsupervised Domain Adaptation

In this work, we present a novel upper bound of target error to address ...

A Unified Joint Maximum Mean Discrepancy for Domain Adaptation

Domain adaptation has received a lot of attention in recent years, and m...

Please sign up or login with your details

Forgot password? Click here to reset