Multi-task Highly Adaptive Lasso

01/27/2023
by   Ivana Malenica, et al.
0

We propose a novel, fully nonparametric approach for the multi-task learning, the Multi-task Highly Adaptive Lasso (MT-HAL). MT-HAL simultaneously learns features, samples and task associations important for the common model, while imposing a shared sparse structure among similar tasks. Given multiple tasks, our approach automatically finds a sparse sharing structure. The proposed MTL algorithm attains a powerful dimension-free convergence rate of o_p(n^-1/4) or better. We show that MT-HAL outperforms sparsity-based MTL competitors across a wide range of simulation studies, including settings with nonlinear and linear relationships, varying levels of sparsity and task correlations, and different numbers of covariates and sample size.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2021

Multi-task Learning for Compositional Data via Sparse Network Lasso

A network lasso enables us to construct a model for each sample, which i...
research
01/17/2022

MT-GBM: A Multi-Task Gradient Boosting Machine with Shared Decision Trees

Despite the success of deep learning in computer vision and natural lang...
research
08/03/2021

Multi-Frequency GPR Microwave Imaging of Sparse Targets Through a Multi-Task Bayesian Compressive Sensing Approach

An innovative inverse scattering (IS) method is proposed for the quantit...
research
07/16/2021

Chi-square and normal inference in high-dimensional multi-task regression

The paper proposes chi-square and normal inference methodologies for the...
research
11/10/2014

Multi-Task Metric Learning on Network Data

Multi-task learning (MTL) improves prediction performance in different c...
research
10/18/2021

A Bayesian approach to multi-task learning with network lasso

Network lasso is a method for solving a multi-task learning problem thro...
research
08/03/2023

Online Multi-Task Learning with Recursive Least Squares and Recursive Kernel Methods

This paper introduces two novel approaches for Online Multi-Task Learnin...

Please sign up or login with your details

Forgot password? Click here to reset