A Unified Perspective on Multi-Domain and Multi-Task Learning

12/23/2014
by   Yongxin Yang, et al.
0

In this paper, we provide a new neural-network based perspective on multi-task learning (MTL) and multi-domain learning (MDL). By introducing the concept of a semantic descriptor, this framework unifies MDL and MTL as well as encompassing various classic and recent MTL/MDL algorithms by interpreting them as different ways of constructing semantic descriptors. Our interpretation provides an alternative pipeline for zero-shot learning (ZSL), where a model for a novel class can be constructed without training data. Moreover, it leads to a new and practically relevant problem setting of zero-shot domain adaptation (ZSDA), which is the analogous to ZSL but for novel domains: A model for an unseen domain can be generated by its semantic descriptor. Experiments across this range of problems demonstrate that our framework outperforms a variety of alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2019

Few-Shot and Zero-Shot Learning for Historical Text Normalization

Historical text normalization often relies on small training datasets. R...
research
03/27/2019

Zero-shot Image Recognition Using Relational Matching, Adaptation and Calibration

Zero-shot learning (ZSL) for image classification focuses on recognizing...
research
06/11/2019

From Fully Supervised to Zero Shot Settings for Twitter Hashtag Recommendation

We propose a comprehensive end-to-end pipeline for Twitter hashtags reco...
research
06/12/2021

Provable Adaptation across Multiway Domains via Representation Learning

This paper studies zero-shot domain adaptation where each domain is inde...
research
07/09/2018

Zero-shot Domain Adaptation without Domain Semantic Descriptors

We propose a method to infer domain-specific models such as classifiers ...
research
10/10/2017

Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot Transfer

Knowledge transfer between tasks can improve the performance of learned ...
research
04/19/2021

Automated problem setting selection in multi-target prediction with AutoMTP

Algorithm Selection (AS) is concerned with the selection of the best-sui...

Please sign up or login with your details

Forgot password? Click here to reset