Bootstrapped Adaptive Threshold Selection for Statistical Model Selection and Estimation

05/13/2015
by   Kristofer E. Bouchard, et al.
0

A central goal of neuroscience is to understand how activity in the nervous system is related to features of the external world, or to features of the nervous system itself. A common approach is to model neural responses as a weighted combination of external features, or vice versa. The structure of the model weights can provide insight into neural representations. Often, neural input-output relationships are sparse, with only a few inputs contributing to the output. In part to account for such sparsity, structured regularizers are incorporated into model fitting optimization. However, by imposing priors, structured regularizers can make it difficult to interpret learned model parameters. Here, we investigate a simple, minimally structured model estimation method for accurate, unbiased estimation of sparse models based on Bootstrapped Adaptive Threshold Selection followed by ordinary least-squares refitting (BoATS). Through extensive numerical investigations, we show that this method often performs favorably compared to L1 and L2 regularizers. In particular, for a variety of model distributions and noise levels, BoATS more accurately recovers the parameters of sparse models, leading to more parsimonious explanations of outputs. Finally, we apply this method to the task of decoding human speech production from ECoG recordings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2012

Structured Input-Output Lasso, with Application to eQTL Mapping, and a Thresholding Algorithm for Fast Estimation

We consider the problem of learning a high-dimensional multi-task regres...
research
03/06/2017

On parameters transformations for emulating sparse priors using variational-Laplace inference

So-called sparse estimators arise in the context of model fitting, when ...
research
05/16/2023

Sparse-group SLOPE: adaptive bi-level selection with FDR-control

In this manuscript, a new high-dimensional approach for simultaneous var...
research
03/01/2019

On the complexity of logistic regression models

We investigate the complexity of logistic regression models which is def...
research
02/20/2022

SOInter: A Novel Deep Energy Based Interpretation Method for Explaining Structured Output Models

We propose a novel interpretation technique to explain the behavior of s...
research
05/27/2023

Structured model selection via ℓ_1-ℓ_2 optimization

Automated model selection is an important application in science and eng...
research
06/12/2018

Sparse Stochastic Zeroth-Order Optimization with an Application to Bandit Structured Prediction

Stochastic zeroth-order (SZO), or gradient-free, optimization allows to ...

Please sign up or login with your details

Forgot password? Click here to reset