An Experiment Design Paradigm using Joint Feature Selection and Task Optimization

10/13/2022
by   Stefano B. Blumberg, et al.
8

This paper presents a subsampling-task paradigm for data-driven task-specific experiment design (ED) and a novel method in populationwide supervised feature selection (FS). Optimal ED, the choice of sampling points under constraints of limited acquisition-time, arises in a wide variety of scientific and engineering contexts. However the continuous optimization used in classical approaches depend on a-priori parameter choices and challenging non-convex optimization landscapes. This paper proposes to replace this strategy with a subsampling-task paradigm, analogous to populationwide supervised FS. In particular, we introduce JOFSTO, which performs JOint Feature Selection and Task Optimization. JOFSTO jointly optimizes two coupled networks: one for feature scoring, which provides the ED, the other for execution of a downstream task or process. Unlike most FS problems, e.g. selecting protein expressions for classification, ED problems typically select from highly correlated globally informative candidates rather than seeking a small number of highly informative features among many uninformative features. JOFSTO's construction efficiently identifies potentially correlated, but effective subsets and returns a trained task network. We demonstrate the approach using parameter estimation and mapping problems in quantitative MRI, where economical ED is crucial for clinical application. Results from simulations and empirical data show the subsampling-task paradigm strongly outperforms classical ED, and within our paradigm, JOFSTO outperforms state-of-the-art supervised FS techniques. JOFSTO extends immediately to wider image-based ED problems and other scenarios where the design must be specified globally across large numbers of acquisitions. Code will be released.

READ FULL TEXT

page 7

page 20

page 21

research
06/04/2021

Top-k Regularization for Supervised Feature Selection

Feature selection identifies subsets of informative features and reduces...
research
09/15/2019

Target-Focused Feature Selection Using a Bayesian Approach

In many real-world scenarios where data is high dimensional, test time a...
research
06/23/2010

A Novel Rough Set Reduct Algorithm for Medical Domain Based on Bee Colony Optimization

Feature selection refers to the problem of selecting relevant features w...
research
05/23/2012

Efficient Sparse Group Feature Selection via Nonconvex Optimization

Sparse feature selection has been demonstrated to be effective in handli...
research
10/11/2021

Deep Unsupervised Feature Selection by Discarding Nuisance and Correlated Features

Modern datasets often contain large subsets of correlated features and n...
research
10/11/2021

Feature Selection for Recommender Systems with Quantum Computing

The promise of quantum computing to open new unexplored possibilities in...
research
11/14/2017

Robust Matrix Elastic Net based Canonical Correlation Analysis: An Effective Algorithm for Multi-View Unsupervised Learning

This paper presents a robust matrix elastic net based canonical correlat...

Please sign up or login with your details

Forgot password? Click here to reset