Vicinal and categorical domain adaptation

03/05/2021
by   Hui Tang, et al.
11

Unsupervised domain adaptation aims to learn a task classifier that performs well on the unlabeled target domain, by utilizing the labeled source domain. Inspiring results have been acquired by learning domain-invariant deep features via domain-adversarial training. However, its parallel design of task and domain classifiers limits the ability to achieve a finer category-level domain alignment. To promote categorical domain adaptation (CatDA), based on a joint category-domain classifier, we propose novel losses of adversarial training at both domain and category levels. Since the joint classifier can be regarded as a concatenation of individual task classifiers respectively for the two domains, our design principle is to enforce consistency of category predictions between the two task classifiers. Moreover, we propose a concept of vicinal domains whose instances are produced by a convex combination of pairs of instances respectively from the two domains. Intuitively, alignment of the possibly infinite number of vicinal domains enhances that of original domains. We propose novel adversarial losses for vicinal domain adaptation (VicDA) based on CatDA, leading to Vicinal and Categorical Domain Adaptation (ViCatDA). We also propose Target Discriminative Structure Recovery (TDSR) to recover the intrinsic target discrimination damaged by adversarial feature alignment. We also analyze the principles underlying the ability of our key designs to align the joint distributions. Extensive experiments on several benchmark datasets demonstrate that we achieve the new state of the art.

READ FULL TEXT
research
11/27/2019

Discriminative Adversarial Domain Adaptation

Given labeled instances on a source domain and unlabeled ones on a targe...
research
08/14/2021

Towards Category and Domain Alignment: Category-Invariant Feature Enhancement for Adversarial Domain Adaptation

Adversarial domain adaptation has made impressive advances in transferri...
research
06/10/2020

Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis

Multi-source unsupervised domain adaptation (MS-UDA) for sentiment analy...
research
08/27/2020

Adversarial Dual Distinct Classifiers for Unsupervised Domain Adaptation

Unsupervised Domain adaptation (UDA) attempts to recognize the unlabeled...
research
03/22/2021

Dynamic Weighted Learning for Unsupervised Domain Adaptation

Unsupervised domain adaptation (UDA) aims to improve the classification ...
research
03/30/2020

Towards Stable and Comprehensive Domain Alignment: Max-Margin Domain-Adversarial Training

Domain adaptation tackles the problem of transferring knowledge from a l...
research
11/15/2022

Explaining Cross-Domain Recognition with Interpretable Deep Classifier

The recent advances in deep learning predominantly construct models in t...

Please sign up or login with your details

Forgot password? Click here to reset