Forward Stability and Model Path Selection

03/05/2021
by   Nicholas Kissel, et al.
0

Most scientific publications follow the familiar recipe of (i) obtain data, (ii) fit a model, and (iii) comment on the scientific relevance of the effects of particular covariates in that model. This approach, however, ignores the fact that there may exist a multitude of similarly-accurate models in which the implied effects of individual covariates may be vastly different. This problem of finding an entire collection of plausible models has also received relatively little attention in the statistics community, with nearly all of the proposed methodologies being narrowly tailored to a particular model class and/or requiring an exhaustive search over all possible models, making them largely infeasible in the current big data era. This work develops the idea of forward stability and proposes a novel, computationally-efficient approach to finding collections of accurate models we refer to as model path selection (MPS). MPS builds up a plausible model collection via a forward selection approach and is entirely agnostic to the model class and loss function employed. The resulting model collection can be displayed in a simple and intuitive graphical fashion, easily allowing practitioners to visualize whether some covariates can be swapped for others with minimal loss.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2020

On forward invariance in Lyapunov stability theorem for local stability

Forward invariance of a basin of attraction is often overlooked when usi...
research
02/10/2022

Loss-guided Stability Selection

In modern data analysis, sparse model selection becomes inevitable once ...
research
06/09/2011

Finding a Path is Harder than Finding a Tree

I consider the problem of learning an optimal path graphical model from ...
research
09/25/2020

Incentivizing Stable Path Selection in Future Internet Architectures

By delegating path control to end-hosts, future Internet architectures o...
research
05/22/2017

On the consistency between model selection and link prediction in networks

A principled approach to understand network structures is to formulate g...
research
11/18/2020

Post-Selection Inference via Algorithmic Stability

Modern approaches to data analysis make extensive use of data-driven mod...
research
05/05/2020

II-20: Intelligent and pragmatic analytic categorization of image collections

We introduce II-20 (Image Insight 2020), a multimedia analytics approach...

Please sign up or login with your details

Forgot password? Click here to reset