A Comprehensive Evaluation of Multi-task Learning and Multi-task Pre-training on EHR Time-series Data

07/20/2020
by   Matthew B. A. McDermott, et al.
10

Multi-task learning (MTL) is a machine learning technique aiming to improve model performance by leveraging information across many tasks. It has been used extensively on various data modalities, including electronic health record (EHR) data. However, despite significant use on EHR data, there has been little systematic investigation of the utility of MTL across the diverse set of possible tasks and training schemes of interest in healthcare. In this work, we examine MTL across a battery of tasks on EHR time-series data. We find that while MTL does suffer from common negative transfer, we can realize significant gains via MTL pre-training combined with single-task fine-tuning. We demonstrate that these gains can be achieved in a task-independent manner and offer not only minor improvements under traditional learning, but also notable gains in a few-shot learning context, thereby suggesting this could be a scalable vehicle to offer improved performance in important healthcare contexts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/08/2023

LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classification

Misogyny and sexism are growing problems in social media. Advances have ...
research
01/26/2021

Muppet: Massive Multi-task Representations with Pre-Finetuning

We propose pre-finetuning, an additional large-scale learning stage betw...
research
09/11/2023

Examining the Effect of Pre-training on Time Series Classification

Although the pre-training followed by fine-tuning paradigm is used exten...
research
12/27/2017

Co-Morbidity Exploration on Wearables Activity Data Using Unsupervised Pre-training and Multi-Task Learning

Physical activity and sleep play a major role in the prevention and mana...
research
07/05/2023

Multi-Task Learning with Summary Statistics

Multi-task learning has emerged as a powerful machine learning paradigm ...
research
10/12/2022

Frustratingly Simple Entity Tracking with Effective Use of Multi-Task Learning Models

We present SET, a frustratingly Simple-yet-effective approach for Entity...
research
09/14/2020

Healthcare Cost Prediction: Leveraging Fine-grain Temporal Patterns

Objective: To design and assess a method to leverage individuals' tempor...

Please sign up or login with your details

Forgot password? Click here to reset