gLOP: the global and Local Penalty for Capturing Predictive Heterogeneity

07/29/2016
by   Rhiannon V. Rose, et al.
0

When faced with a supervised learning problem, we hope to have rich enough data to build a model that predicts future instances well. However, in practice, problems can exhibit predictive heterogeneity: most instances might be relatively easy to predict, while others might be predictive outliers for which a model trained on the entire dataset does not perform well. Identifying these can help focus future data collection. We present gLOP, the global and Local Penalty, a framework for capturing predictive heterogeneity and identifying predictive outliers. gLOP is based on penalized regression for multitask learning, which improves learning by leveraging training signal information from related tasks. We give two optimization algorithms for gLOP, one space-efficient, and another giving the full regularization path. We also characterize uniqueness in terms of the data and tuning parameters, and present empirical results on synthetic data and on two health research problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/10/2021

Deducing of Optimal Machine Learning Algorithms for Heterogeneity

For defining the optimal machine learning algorithm, the decision was no...
research
04/18/2022

FedKL: Tackling Data Heterogeneity in Federated Reinforcement Learning by Penalizing KL Divergence

As a distributed learning paradigm, Federated Learning (FL) faces the co...
research
04/01/2023

Predictive Heterogeneity: Measures and Applications

As an intrinsic and fundamental property of big data, data heterogeneity...
research
05/31/2023

Assessing the Generalizability of a Performance Predictive Model

A key component of automated algorithm selection and configuration, whic...
research
01/02/2021

Integrated Optimization of Predictive and Prescriptive Tasks

In traditional machine learning techniques, the degree of closeness betw...
research
04/26/2019

Structural modeling using overlapped group penalties for discovering predictive biomarkers for subgroup analysis

The identification of predictive biomarkers from a large scale of covari...
research
06/22/2021

Predictive multiview embedding

Multiview embedding is a way to model strange attractors that takes adva...

Please sign up or login with your details

Forgot password? Click here to reset