Interpretable MTL from Heterogeneous Domains using Boosted Tree

03/16/2020
by   Ya-Lin Zhang, et al.
0

Multi-task learning (MTL) aims at improving the generalization performance of several related tasks by leveraging useful information contained in them. However, in industrial scenarios, interpretability is always demanded, and the data of different tasks may be in heterogeneous domains, making the existing methods unsuitable or unsatisfactory. In this paper, following the philosophy of boosted tree, we proposed a two-stage method. In stage one, a common model is built to learn the commonalities using the common features of all instances. Different from the training of conventional boosted tree model, we proposed a regularization strategy and an early-stopping mechanism to optimize the multi-task learning process. In stage two, started by fitting the residual error of the common model, a specific model is constructed with the task-specific instances to further boost the performance. Experiments on both benchmark and real-world datasets validate the effectiveness of the proposed method. What's more, interpretability can be naturally obtained from the tree based method, satisfying the industrial needs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/04/2023

Multi-Task Learning with Prior Information

Multi-task learning aims to boost the generalization performance of mult...
research
03/30/2023

Multi-Task Learning for Post-transplant Cause of Death Analysis: A Case Study on Liver Transplant

Organ transplant is the essential treatment method for some end-stage di...
research
01/27/2021

Language Modelling as a Multi-Task Problem

In this paper, we propose to study language modelling as a multi-task pr...
research
08/11/2022

MultiMatch: Multi-task Learning for Semi-supervised Domain Generalization

Domain generalization (DG) aims at learning a model on source domains to...
research
04/26/2023

Multi-Task Learning Regression via Convex Clustering

Multi-task learning (MTL) is a methodology that aims to improve the gene...
research
03/15/2020

Adversarial Encoder-Multi-Task-Decoder for Multi-Stage Processes

In multi-stage processes, decisions occur in an ordered sequence of stag...
research
10/24/2020

Multi-task Supervised Learning via Cross-learning

In this paper we consider a problem known as multi-task learning, consis...

Please sign up or login with your details

Forgot password? Click here to reset