Deep Asymmetric Multi-task Feature Learning

08/01/2017
by   Hae Beom Lee, et al.
0

We propose Deep Asymmetric Multitask Feature Learning (Deep-AMTFL) which can learn deep representations shared across multiple tasks while effectively preventing negative transfer that may happen in the feature sharing process. Specifically, we introduce an asymmetric autoencoder term that allows reliable predictors for the easy tasks to have high contribution to the feature learning while suppressing the influences of unreliable predictors for more difficult tasks. This allows the learning of less noisy representations, and enables unreliable predictors to exploit knowledge from the reliable predictors via the shared latent features. Such asymmetric knowledge transfer through shared features is also more scalable and efficient than inter-task asymmetric transfer. We validate our Deep-AMTFL model on multiple benchmark datasets for multitask learning and image classification, on which it significantly outperforms existing symmetric and asymmetric multitask learning models, by effectively preventing negative transfer in deep feature learning.

READ FULL TEXT
research
12/17/2020

Task Uncertainty Loss Reduce Negative Transfer in Asymmetric Multi-task Feature Learning

Multi-task learning (MTL) is frequently used in settings where a target ...
research
04/03/2019

On Better Exploring and Exploiting Task Relationships in Multi-Task Learning: Joint Model and Feature Learning

Multitask learning (MTL) aims to learn multiple tasks simultaneously thr...
research
12/17/2020

Learning and Sharing: A Multitask Genetic Programming Approach to Image Feature Learning

Using evolutionary computation algorithms to solve multiple tasks with k...
research
03/06/2019

Representative Task Self-selection for Flexible Clustered Lifelong Learning

Consider the lifelong learning paradigm whose objective is to learn a se...
research
11/10/2017

Modeling Asymmetric Relationships from Symmetric Networks

Many relationships requiring mutual agreement between pairs of actors pr...
research
03/02/2017

Self-Paced Multitask Learning with Shared Knowledge

This paper introduces self-paced task selection to multitask learning, w...
research
06/06/2016

Integrated perception with recurrent multi-task neural networks

Modern discriminative predictors have been shown to match natural intell...

Please sign up or login with your details

Forgot password? Click here to reset