Value of Information Lattice: Exploiting Probabilistic Independence for Effective Feature Subset Acquisition

01/16/2014
by   Mustafa Bilgic, et al.
0

We address the cost-sensitive feature acquisition problem, where misclassifying an instance is costly but the expected misclassification cost can be reduced by acquiring the values of the missing features. Because acquiring the features is costly as well, the objective is to acquire the right set of features so that the sum of the feature acquisition cost and misclassification cost is minimized. We describe the Value of Information Lattice (VOILA), an optimal and efficient feature subset acquisition framework. Unlike the common practice, which is to acquire features greedily, VOILA can reason with subsets of features. VOILA efficiently searches the space of possible feature subsets by discovering and exploiting conditional independence properties between the features and it reuses probabilistic inference computations to further speed up the process. Through empirical evaluation on five medical datasets, we show that the greedy strategy is often reluctant to acquire features, as it cannot forecast the benefit of acquiring multiple features in combination.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/18/2017

Why Pay More When You Can Pay Less: A Joint Learning Framework for Active Feature Acquisition and Classification

We consider the problem of active feature acquisition, where we sequenti...
research
02/15/2018

Active Feature Acquisition with Supervised Matrix Completion

Feature missing is a serious problem in many applications, which may lea...
research
02/27/2023

Acquisition Conditioned Oracle for Nongreedy Active Feature Acquisition

We develop novel methodology for active feature acquisition (AFA), the s...
research
09/28/2018

EDDI: Efficient Dynamic Discovery of High-Value Information with Partial VAE

Making decisions requires information relevant to the task at hand. Many...
research
01/02/2019

Opportunistic Learning: Budgeted Cost-Sensitive Learning from Data Streams

In many real-world learning scenarios, features are only acquirable at a...
research
02/19/2019

Nutrition and Health Data for Cost-Sensitive Learning

Traditionally, machine learning algorithms have been focused on modeling...
research
12/17/2019

Cost-Sensitive Feature-Value Acquisition Using Feature Relevance

In many real-world machine learning problems, feature values are not rea...

Please sign up or login with your details

Forgot password? Click here to reset