Attention Regularized Laplace Graph for Domain Adaptation

10/15/2022
by   Lingkun Luo, et al.
0

In leveraging manifold learning in domain adaptation (DA), graph embedding-based DA methods have shown their effectiveness in preserving data manifold through the Laplace graph. However, current graph embedding DA methods suffer from two issues: 1). they are only concerned with preservation of the underlying data structures in the embedding and ignore sub-domain adaptation, which requires taking into account intra-class similarity and inter-class dissimilarity, thereby leading to negative transfer; 2). manifold learning is proposed across different feature/label spaces separately, thereby hindering unified comprehensive manifold learning. In this paper, starting from our previous DGA-DA, we propose a novel DA method, namely Attention Regularized Laplace Graph-based Domain Adaptation (ARG-DA), to remedy the aforementioned issues. Specifically, by weighting the importance across different sub-domain adaptation tasks, we propose the Attention Regularized Laplace Graph for class-aware DA, thereby generating the attention regularized DA. Furthermore, using a specifically designed FEEL strategy, our approach dynamically unifies alignment of the manifold structures across different feature/label spaces, thus leading to comprehensive manifold learning. Comprehensive experiments are carried out to verify the effectiveness of the proposed DA method, which consistently outperforms the state-of-the-art DA methods on 7 standard DA benchmarks, i.e., 37 cross-domain image classification tasks including object, face, and digit images. An in-depth analysis of the proposed DA method is also discussed, including sensitivity, convergence, and robustness.

READ FULL TEXT

page 1

page 11

page 18

research
02/21/2018

Discriminative Label Consistent Domain Adaptation

Domain adaptation (DA) is transfer learning which aims to learn an effec...
research
05/24/2022

On statistic alignment for domain adaptation in structural health monitoring

The practical application of structural health monitoring (SHM) is often...
research
03/12/2017

A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation

Recently, DNN model compression based on network architecture design, e....
research
06/22/2017

Nonlinear Embedding Transform for Unsupervised Domain Adaptation

The problem of domain adaptation (DA) deals with adapting classifier mod...
research
08/12/2021

Semantic Concentration for Domain Adaptation

Domain adaptation (DA) paves the way for label annotation and dataset bi...
research
08/16/2019

Shallow Domain Adaptive Embeddings for Sentiment Analysis

This paper proposes a way to improve the performance of existing algorit...
research
03/15/2023

From Images to Features: Unbiased Morphology Classification via Variational Auto-Encoders and Domain Adaptation

We present a novel approach for the dimensionality reduction of galaxy i...

Please sign up or login with your details

Forgot password? Click here to reset