Log In Sign Up

Decomposition of Global Feature Importance into Direct and Associative Components (DEDACT)

by   Gunnar König, et al.

Global model-agnostic feature importance measures either quantify whether features are directly used for a model's predictions (direct importance) or whether they contain prediction-relevant information (associative importance). Direct importance provides causal insight into the model's mechanism, yet it fails to expose the leakage of information from associated but not directly used variables. In contrast, associative importance exposes information leakage but does not provide causal insight into the model's mechanism. We introduce DEDACT - a framework to decompose well-established direct and associative importance measures into their respective associative and direct components. DEDACT provides insight into both the sources of prediction-relevant information in the data and the direct and indirect feature pathways by which the information enters the model. We demonstrate the method's usefulness on simulated examples.


page 1

page 2

page 3

page 4


Relative Feature Importance

Interpretable Machine Learning (IML) methods are used to gain insight in...

Randomized Ablation Feature Importance

Given a model f that predicts a target y from a vector of input features...

Direct and Indirect Effects – An Information Theoretic Perspective

Information theoretic (IT) approaches to quantifying causal influences h...

Understanding Global Feature Contributions Through Additive Importance Measures

Understanding the inner workings of complex machine learning models is a...

Granger-causal Attentive Mixtures of Experts

Several methods have recently been proposed to detect salient input feat...

Unifying local and global model explanations by functional decomposition of low dimensional structures

We consider a global explanation of a regression or classification funct...

On Shapley Credit Allocation for Interpretability

We emphasize the importance of asking the right question when interpreti...