Maximizing Invariant Data Perturbation with Stochastic Optimization

07/12/2018
by   Kouichi Ikeno, et al.
2

Feature attribution methods, or saliency maps, are one of the most popular approaches for explaining the decisions of complex machine learning models such as deep neural networks. In this study, we propose a stochastic optimization approach for the perturbation-based feature attribution method. While the original optimization problem of the perturbation-based feature attribution is difficult to solve because of the complex constraints, we propose to reformulate the problem as the maximization of a differentiable function, which can be solved using gradient-based algorithms. In particular, stochastic optimization is well-suited for the proposed reformulation, and we can solve the problem using popular algorithms such as SGD, RMSProp, and Adam. The experiment on the image classification with VGG16 shows that the proposed method could identify relevant parts of the images effectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/29/2020

Conjugate-gradient-based Adam for stochastic optimization and its application to deep learning

This paper proposes a conjugate-gradient-based Adam algorithm blending A...
research
06/19/2018

Maximally Invariant Data Perturbation as Explanation

While several feature scoring methods are proposed to explain the output...
research
10/18/2019

Understanding Deep Networks via Extremal Perturbations and Smooth Masks

The problem of attribution is concerned with identifying the parts of an...
research
06/14/2022

Machines Explaining Linear Programs

There has been a recent push in making machine learning models more inte...
research
06/14/2022

Attributions Beyond Neural Networks: The Linear Program Case

Linear Programs (LPs) have been one of the building blocks in machine le...
research
08/02/2017

Application of a Second-order Stochastic Optimization Algorithm for Fitting Stochastic Epidemiological Models

Epidemiological models have tremendous potential to forecast disease bur...
research
07/03/2018

Stochastic optimization approaches to learning concise representations

We propose and study a method for learning interpretable features via st...

Please sign up or login with your details

Forgot password? Click here to reset