Beyond without Forgetting: Multi-Task Learning for Classification with Disjoint Datasets

03/15/2020
by   Yan Hong, et al.
13

Multi-task Learning (MTL) for classification with disjoint datasets aims to explore MTL when one task only has one labeled dataset. In existing methods, for each task, the unlabeled datasets are not fully exploited to facilitate this task. Inspired by semi-supervised learning, we use unlabeled datasets with pseudo labels to facilitate each task. However, there are two major issues: 1) the pseudo labels are very noisy; 2) the unlabeled datasets and the labeled dataset for each task has considerable data distribution mismatch. To address these issues, we propose our MTL with Selective Augmentation (MTL-SA) method to select the training samples in unlabeled datasets with confident pseudo labels and close data distribution to the labeled dataset. Then, we use the selected training samples to add information and use the remaining training samples to preserve information. Extensive experiments on face-centric and human-centric applications demonstrate the effectiveness of our MTL-SA method.

READ FULL TEXT
research
06/15/2023

Knowledge Assembly: Semi-Supervised Multi-Task Learning from Multiple Datasets with Disjoint Labels

In real-world scenarios we often need to perform multiple tasks simultan...
research
08/11/2022

MultiMatch: Multi-task Learning for Semi-supervised Domain Generalization

Domain generalization (DG) aims at learning a model on source domains to...
research
06/07/2023

Align, Distill, and Augment Everything All at Once for Imbalanced Semi-Supervised Learning

Addressing the class imbalance in long-tailed semi-supervised learning (...
research
02/21/2016

Multi-Task Learning with Labeled and Unlabeled Tasks

In multi-task learning, a learner is given a collection of prediction ta...
research
02/11/2022

Distributionally Robust Data Join

Suppose we are given two datasets: a labeled dataset and unlabeled datas...
research
02/24/2022

Self-Training: A Survey

In recent years, semi-supervised algorithms have received a lot of inter...
research
06/07/2022

Self-Training of Handwritten Word Recognition for Synthetic-to-Real Adaptation

Performances of Handwritten Text Recognition (HTR) models are largely de...

Please sign up or login with your details

Forgot password? Click here to reset