AutoMTL: A Programming Framework for Automated Multi-Task Learning

10/25/2021
by   Moshe Y. Vardi, et al.
0

Multi-task learning (MTL) jointly learns a set of tasks. It is a promising approach to reduce the training and inference time and storage costs while improving prediction accuracy and generalization performance for many computer vision tasks. However, a major barrier preventing the widespread adoption of MTL is the lack of systematic support for developing compact multi-task models given a set of tasks. In this paper, we aim to remove the barrier by developing the first programming framework AutoMTL that automates MTL model development. AutoMTL takes as inputs an arbitrary backbone convolutional neural network and a set of tasks to learn, then automatically produce a multi-task model that achieves high accuracy and has small memory footprint simultaneously. As a programming framework, AutoMTL could facilitate the development of MTL-enabled computer vision applications and even further improve task performance. Code of AutoMTL will be available at https://github.com/zhanglijun95/AutoMTL

READ FULL TEXT

page 4

page 5

page 7

page 8

page 9

page 11

page 12

page 13

research
05/18/2019

Which Tasks Should Be Learned Together in Multi-task Learning?

Many computer vision applications require solving multiple tasks in real...
research
03/10/2022

A Tree-Structured Multi-Task Model Recommender

Tree-structured multi-task architectures have been employed to jointly t...
research
02/07/2022

Auto-Lambda: Disentangling Dynamic Task Relationships

Understanding the structure of multiple related tasks allows for multi-t...
research
03/21/2020

Multi-Task Learning Enhanced Single Image De-Raining

Rain removal in images is an important task in computer vision filed and...
research
05/10/2021

You Only Learn One Representation: Unified Network for Multiple Tasks

People “understand” the world via vision, hearing, tactile, and also the...
research
07/17/2018

A Modulation Module for Multi-task Learning with Applications in Image Retrieval

Multi-task learning has been widely adopted in many computer vision task...

Please sign up or login with your details

Forgot password? Click here to reset