Asymptotic performance of regularized multi-task learning

05/31/2018
by   Shaohan Chen, et al.
0

This paper analyzes asymptotic performance of a regularized multi-task learning model where task parameters are optimized jointly. If tasks are closely related, empirical work suggests multi-task learning models to outperform single-task ones in finite sample cases. As data size grows indefinitely, we show the learned multi-classifier to optimize an average misclassification error function which depicts the risk of applying multi-task learning algorithm to making decisions. This technique conclusion demonstrates the regularized multi-task learning model to be able to produce reliable decision rule for each task in the sense that it will asymptotically converge to the corresponding Bayes rule. Also, we find the interaction effect between tasks vanishes as data size growing indefinitely, which is quite different from the behavior in finite sample cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/15/2018

Multi-Tasking Evolutionary Algorithm (MTEA) for Single-Objective Continuous Optimization

Multi-task learning uses auxiliary data or knowledge from relevant tasks...
research
11/26/2021

BCH-NLP at BioCreative VII Track 3: medications detection in tweets using transformer networks and multi-task learning

In this paper, we present our work participating in the BioCreative VII ...
research
03/30/2023

Multi-Task Learning for Post-transplant Cause of Death Analysis: A Case Study on Liver Transplant

Organ transplant is the essential treatment method for some end-stage di...
research
11/02/2012

Learning curves for multi-task Gaussian process regression

We study the average case performance of multi-task Gaussian process (GP...
research
10/02/2021

Fast Line Search for Multi-Task Learning

Multi-task learning is a powerful method for solving several tasks joint...
research
09/11/2020

Learning an Interpretable Graph Structure in Multi-Task Learning

We present a novel methodology to jointly perform multi-task learning an...
research
09/14/2021

The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders

Multi-task learning with transformer encoders (MTL) has emerged as a pow...

Please sign up or login with your details

Forgot password? Click here to reset