Robust Unsupervised Domain Adaptation for Neural Networks via Moment Alignment

11/16/2017
by   Werner Zellinger, et al.
0

A novel approach for unsupervised domain adaptation for neural networks is proposed that relies on a metric-based regularization of the learning process. The metric-based regularization aims at domain-invariant latent feature representations by means of maximizing the similarity between domain-specific activation distributions. The proposed metric results from modifying an integral probability metric in a way such that it becomes translation-invariant on a polynomial reproducing kernel Hilbert space. The metric has an intuitive interpretation in the dual space as sum of differences of central moments of the corresponding activation distributions. As demonstrated by an analysis on standard benchmark datasets for sentiment analysis and object recognition the outlined approach shows more robustness parameter changes than state-of-the-art approaches while achieving even higher classification accuracies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2017

Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learning

The learning of domain-invariant representations in the context of domai...
research
06/27/2012

Information-Theoretical Learning of Discriminative Clusters for Unsupervised Domain Adaptation

We study the problem of unsupervised domain adaptation, which aims to ad...
research
07/18/2020

DWMD: Dimensional Weighted Orderwise Moment Discrepancy for Domain-specific Hidden Representation Matching

Knowledge transfer from a source domain to a different but semantically ...
research
05/26/2019

Unsupervised Domain Adaptation via Regularized Conditional Alignment

We propose a method for unsupervised domain adaptation that trains a sha...
research
12/21/2022

Learning List-Level Domain-Invariant Representations for Ranking

Domain adaptation aims to transfer the knowledge acquired by models trai...
research
04/17/2023

Implicit Bayes Adaptation: A Collaborative Transport Approach

The power and flexibility of Optimal Transport (OT) have pervaded a wide...
research
07/31/2021

Conditional Bures Metric for Domain Adaptation

As a vital problem in classification-oriented transfer, unsupervised dom...

Please sign up or login with your details

Forgot password? Click here to reset