Target contrastive pessimistic risk for robust domain adaptation

06/25/2017
by   Wouter M. Kouw, et al.
0

In domain adaptation, classifiers with information from a source domain adapt to generalize to a target domain. However, an adaptive classifier can perform worse than a non-adaptive classifier due to invalid assumptions, increased sensitivity to estimation errors or model misspecification. Our goal is to develop a domain-adaptive classifier that is robust in the sense that it does not rely on restrictive assumptions on how the source and target domains relate to each other and that it does not perform worse than the non-adaptive classifier. We formulate a conservative parameter estimator that only deviates from the source classifier when a lower risk is guaranteed for all possible labellings of the given target samples. We derive the classical least-squares and discriminant analysis cases and show that these perform on par with state-of-the-art domain adaptive classifiers in sample selection bias settings, while outperforming them in more general domain adaptation settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2018

Target Contrastive Pessimistic Discriminant Analysis

Domain-adaptive classifiers learn from a source domain and aim to genera...
research
02/27/2023

Approximately optimal domain adaptation with Fisher's Linear Discriminant Analysis

We propose a class of models based on Fisher's Linear Discriminant (FLD)...
research
12/15/2015

Feature-Level Domain Adaptation

Domain adaptation is the supervised learning setting in which the traini...
research
06/01/2021

Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Least squares estimators, when trained on a few target domain samples, m...
research
08/22/2014

Hierarchical Adaptive Structural SVM for Domain Adaptation

A key topic in classification is the accuracy loss produced when the dat...
research
09/18/2022

Domain Classification-based Source-specific Term Penalization for Domain Adaptation in Hate-speech Detection

State-of-the-art approaches for hate-speech detection usually exhibit po...
research
02/27/2023

Domain Adaptive Decision Trees: Implications for Accuracy and Fairness

In uses of pre-trained machine learning models, it is a known issue that...

Please sign up or login with your details

Forgot password? Click here to reset