Creating Powerful and Interpretable Models withRegression Networks

by   Lachlan O'Neill, et al.
Monash University

As the discipline has evolved, research in machine learning has been focused more and more on creating more powerful neural networks, without regard for the interpretability of these networks. Such "black-box models" yield state-of-the-art results, but we cannot understand why they make a particular decision or prediction. Sometimes this is acceptable, but often it is not. We propose a novel architecture, Regression Networks, which combines the power of neural networks with the understandability of regression analysis. While some methods for combining these exist in the literature, our architecture generalizes these approaches by taking interactions into account, offering the power of a dense neural network without forsaking interpretability. We demonstrate that the models exceed the state-of-the-art performance of interpretable models on several benchmark datasets, matching the power of a dense neural network. Finally, we discuss how these techniques can be generalized to other neural architectures, such as convolutional and recurrent neural networks.


Interpretable Neural Networks for Panel Data Analysis in Economics

The lack of interpretability and transparency are preventing economists ...

Interpretable Semantic Photo Geolocalization

Planet-scale photo geolocalization is the complex task of estimating the...

Interpreting RNN behaviour via excitable network attractors

Machine learning has become a basic tool in scientific research and for ...

Black box modelling of HVAC system : improving the performances of neural networks

This paper deals with neural networks modelling of HVAC systems. In orde...

SegNBDT: Visual Decision Rules for Segmentation

The black-box nature of neural networks limits model decision interpreta...

A Double Penalty Model for Interpretability

Modern statistical learning techniques have often emphasized prediction ...

Interpretable learning of effective dynamics for multiscale systems

The modeling and simulation of high-dimensional multiscale systems is a ...

Please sign up or login with your details

Forgot password? Click here to reset