Domain Adaptation via Prompt Learning

02/14/2022
by   Chunjiang Ge, et al.
0

Unsupervised domain adaption (UDA) aims to adapt models learned from a well-annotated source domain to a target domain, where only unlabeled samples are given. Current UDA approaches learn domain-invariant features by aligning source and target feature spaces. Such alignments are imposed by constraints such as statistical discrepancy minimization or adversarial training. However, these constraints could lead to the distortion of semantic feature structures and loss of class discriminability. In this paper, we introduce a novel prompt learning paradigm for UDA, named Domain Adaptation via Prompt Learning (DAPL). In contrast to prior works, our approach makes use of pre-trained vision-language models and optimizes only very few parameters. The main idea is to embed domain information into prompts, a form of representations generated from natural language, which is then used to perform classification. This domain information is shared only by images from the same domain, thereby dynamically adapting the classifier according to each domain. By adopting this paradigm, we show that our model not only outperforms previous methods on several cross-domain benchmarks but also is very efficient to train and easy to implement.

READ FULL TEXT
research
06/29/2021

Cross-domain error minimization for unsupervised domain adaptation

Unsupervised domain adaptation aims to transfer knowledge from a labeled...
research
04/01/2022

Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain Adaptation

We consider unsupervised domain adaptation (UDA), where labeled data fro...
research
09/24/2020

Feature Adaptation of Pre-Trained Language Models across Languages and Domains for Text Classification

Adapting pre-trained language models (PrLMs) (e.g., BERT) to new domains...
research
02/07/2023

UDApter – Efficient Domain Adaptation Using Adapters

We propose two methods to make unsupervised domain adaptation (UDA) more...
research
03/26/2020

Unsupervised domain adaptation with exploring more statistics and discriminative information

Unsupervised domain adaptation aims at transferring knowledge from the l...
research
08/13/2021

Learning Transferable Parameters for Unsupervised Domain Adaptation

Unsupervised domain adaptation (UDA) enables a learning machine to adapt...
research
02/24/2022

Attentive Temporal Pooling for Conformer-based Streaming Language Identification in Long-form Speech

In this paper, we introduce a novel language identification system based...

Please sign up or login with your details

Forgot password? Click here to reset