Active Selection of Classification Features

by   Thomas T. Kok, et al.

Some data analysis applications comprise datasets, where explanatory variables are expensive or tedious to acquire, but auxiliary data are readily available and might help to construct an insightful training set. An example is neuroimaging research on mental disorders, specifically learning a diagnosis/prognosis model based on variables derived from expensive Magnetic Resonance Imaging (MRI) scans, which often requires large sample sizes. Auxiliary data, such as demographics, might help in selecting a smaller sample that comprises the individuals with the most informative MRI scans. In active learning literature, this problem has not yet been studied, despite promising results in related problem settings that concern the selection of instances or instance-feature pairs. Therefore, we formulate this complementary problem of Active Selection of Classification Features (ASCF): Given a primary task, which requires to learn a model f: x-> y to explain/predict the relationship between an expensive-to-acquire set of variables x and a class label y. Then, the ASCF-task is to use a set of readily available selection variables z to select these instances, that will improve the primary task's performance most when acquiring their expensive features z and including them to the primary training set. We propose two utility-based approaches for this problem, and evaluate their performance on three public real-world benchmark datasets. In addition, we illustrate the use of these approaches to efficiently acquire MRI scans in the context of neuroimaging research on mental disorders, based on a simulated study design with real MRI data.



There are no comments yet.


page 1

page 2

page 3

page 4


Deep Learning for Musculoskeletal Image Analysis

The diagnosis, prognosis, and treatment of patients with musculoskeletal...

An information criterion for auxiliary variable selection in incomplete data analysis

Statistical inference is considered for variables of interest, called pr...

Multiple Instance Learning with Auxiliary Task Weighting for Multiple Myeloma Classification

Whole body magnetic resonance imaging (WB-MRI) is the recommended modali...

PAL : Pretext-based Active Learning

When obtaining labels is expensive, the requirement of a large labeled t...

Localized Motion Artifact Reduction on Brain MRI Using Deep Learning with Effective Data Augmentation Techniques

In-scanner motion degrades the quality of magnetic resonance imaging (MR...

Active Learning Using Uncertainty Information

Many active learning methods belong to the retraining-based approaches, ...

Committee-Based Sample Selection for Probabilistic Classifiers

In many real-world learning tasks, it is expensive to acquire a sufficie...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.