Neural Additive Models: Interpretable Machine Learning with Neural Nets

04/29/2020 ∙ by Rishabh Agarwal, et al. ∙ 11

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their decisions. This hinders their applicability to high stakes decision-making domains such as healthcare. We propose Neural Additive Models (NAMs) which combine some of the expressivity of DNNs with the inherent intelligibility of generalized additive models. NAMs learn a linear combination of neural networks that each attend to a single input feature. These networks are trained jointly and can learn arbitrarily complex relationships between their input feature and the output. Our experiments on regression and classification datasets show that NAMs are more accurate than widely used intelligible models such as logistic regression and shallow decision trees. They perform similarly to existing state-of-the-art generalized additive models in accuracy, but can be more easily applied to real-world problems.



There are no comments yet.


page 6

page 7

page 16

Code Repositories


Repo for open sourcing the NAMs.

view repo


stand alone Neural Additive Models, forked from google-reasearch for easy import to colab

view repo


Neural Additive Models (Google Research)

view repo


Unofficial PyTorch implementation of Neural Additive Models (NAM) by Agarwal, et al.

view repo


PyTorch implementation for Neural Additive Models

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.