DeepAI AI Chat
Log In Sign Up

DeepNNK: Explaining deep models and their generalization using polytope interpolation

07/20/2020
by   Sarath Shekkizhar, et al.
University of Southern California
5

Modern machine learning systems based on neural networks have shown great success in learning complex data patterns while being able to make good predictions on unseen data points. However, the limited interpretability of these systems hinders further progress and application to several domains in the real world. This predicament is exemplified by time consuming model selection and the difficulties faced in predictive explainability, especially in the presence of adversarial examples. In this paper, we take a step towards better understanding of neural networks by introducing a local polytope interpolation method. The proposed Deep Non Negative Kernel regression (NNK) interpolation framework is non parametric, theoretically simple and geometrically intuitive. We demonstrate instance based explainability for deep learning models and develop a method to identify models with good generalization properties using leave one out estimation. Finally, we draw a rationalization to adversarial and generative examples which are inevitable from an interpolation view of machine learning.

READ FULL TEXT

page 6

page 7

page 8

11/26/2020

Explaining Deep Learning Models for Structured Data using Layer-Wise Relevance Propagation

Trust and credibility in machine learning models is bolstered by the abi...
05/29/2021

Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation

In the past decade the mathematical theory of machine learning has lagge...
06/25/2019

Explaining Deep Learning Models with Constrained Adversarial Examples

Machine learning algorithms generally suffer from a problem of explainab...
08/15/2021

Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Time

In several real world applications, machine learning models are deployed...
11/12/2022

Deep Learning Generates Synthetic Cancer Histology for Explainability and Education

Artificial intelligence (AI) methods including deep neural networks can ...

Code Repositories

DeepNNK_polytope_interpolation

Non parametric, polytope interpolation framework for use with deep learning models


view repo