Heuristic Domain Adaptation

11/30/2020
by   Shuhao Cui, et al.
0

In visual domain adaptation (DA), separating the domain-specific characteristics from the domain-invariant representations is an ill-posed problem. Existing methods apply different kinds of priors or directly minimize the domain discrepancy to address this problem, which lack flexibility in handling real-world situations. Another research pipeline expresses the domain-specific information as a gradual transferring process, which tends to be suboptimal in accurately removing the domain-specific properties. In this paper, we address the modeling of domain-invariant and domain-specific information from the heuristic search perspective. We identify the characteristics in the existing representations that lead to larger domain discrepancy as the heuristic representations. With the guidance of heuristic representations, we formulate a principled framework of Heuristic Domain Adaptation (HDA) with well-founded theoretical guarantees. To perform HDA, the cosine similarity scores and independence measurements between domain-invariant and domain-specific representations are cast into the constraints at the initial and final states during the learning procedure. Similar to the final condition of heuristic search, we further derive a constraint enforcing the final range of heuristic network output to be small. Accordingly, we propose Heuristic Domain Adaptation Network (HDAN), which explicitly learns the domain-invariant and domain-specific representations with the above mentioned constraints. Extensive experiments show that HDAN has exceeded state-of-the-art on unsupervised DA, multi-source DA and semi-supervised DA. The code is available at https://github.com/cuishuhao/HDA.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2020

Gradually Vanishing Bridge for Adversarial Domain Adaptation

In unsupervised domain adaptation, rich domain-specific characteristics ...
research
06/22/2021

Enhanced Separable Disentanglement for Unsupervised Domain Adaptation

Domain adaptation aims to mitigate the domain gap when transferring know...
research
10/26/2020

An Adversarial Domain Separation Framework for Septic Shock Early Prediction Across EHR Systems

Modeling patient disease progression using Electronic Health Records (EH...
research
08/27/2023

Domain-Specificity Inducing Transformers for Source-Free Domain Adaptation

Conventional Domain Adaptation (DA) methods aim to learn domain-invarian...
research
11/27/2021

On Learning Domain-Invariant Representations for Transfer Learning with Multiple Sources

Domain adaptation (DA) benefits from the rigorous theoretical works that...
research
09/25/2019

Domain-invariant Learning using Adaptive Filter Decomposition

Domain shifts are frequently encountered in real-world scenarios. In thi...
research
05/22/2023

POEM: Polarization of Embeddings for Domain-Invariant Representations

Handling out-of-distribution samples is a long-lasting challenge for dee...

Please sign up or login with your details

Forgot password? Click here to reset