Black-box Probe for Unsupervised Domain Adaptation without Model Transferring

07/21/2021
by   Kunhong Wu, et al.
3

In recent years, researchers have been paying increasing attention to the threats brought by deep learning models to data security and privacy, especially in the field of domain adaptation. Existing unsupervised domain adaptation (UDA) methods can achieve promising performance without transferring data from source domain to target domain. However, UDA with representation alignment or self-supervised pseudo-labeling relies on the transferred source models. In many data-critical scenarios, methods based on model transferring may suffer from membership inference attacks and expose private data. In this paper, we aim to overcome a challenging new setting where the source models are only queryable but cannot be transferred to the target domain. We propose Black-box Probe Domain Adaptation (BPDA), which adopts query mechanism to probe and refine information from source model using third-party dataset. In order to gain more informative query results, we further propose Distributionally Adversarial Training (DAT) to align the distribution of third-party data with that of target data. BPDA uses public third-party dataset and adversarial examples based on DAT as the information carrier between source and target domains, dispensing with transferring source data or model. Experimental results on benchmarks of Digit-Five, Office-Caltech, Office-31, Office-Home, and DomainNet demonstrate the feasibility of BPDA without model transferring.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 8

page 9

page 10

research
01/08/2021

Unsupervised Domain Adaptation of Black-Box Source Models

Unsupervised domain adaptation (UDA) aims to learn a model for unlabeled...
research
08/16/2022

Unsupervised Domain Adaptation for Segmentation with Black-box Source Model

Unsupervised domain adaptation (UDA) has been widely used to transfer kn...
research
12/31/2022

Source-Free Unsupervised Domain Adaptation: A Survey

Unsupervised domain adaptation (UDA) via deep learning has attracted app...
research
02/10/2023

Key Design Choices for Double-Transfer in Source-Free Unsupervised Domain Adaptation

Fine-tuning and Domain Adaptation emerged as effective strategies for ef...
research
03/04/2023

Visualizing Transferred Knowledge: An Interpretive Model of Unsupervised Domain Adaptation

Many research efforts have been committed to unsupervised domain adaptat...
research
04/04/2021

Distill and Fine-tune: Effective Adaptation from a Black-box Source Model

To alleviate the burden of labeling, unsupervised domain adaptation (UDA...
research
05/04/2023

DomainInv: Domain Invariant Fine Tuning and Adversarial Label Correction For QA Domain Adaptation

Existing Question Answering (QA) systems limited by the capability of an...

Please sign up or login with your details

Forgot password? Click here to reset