A Unifying Network Architecture for Semi-Structured Deep Distributional Learning

02/13/2020
by   David Rügamer, et al.
22

We propose a unifying network architecture for deep distributional learning in which entire distributions can be learned in a general framework of interpretable regression models and deep neural networks. Previous approaches that try to combine advanced statistical models and deep neural networks embed the neural network part as a predictor in an additive regression model. In contrast, our approach estimates the statistical model part within a unifying neural network by projecting the deep learning model part into the orthogonal complement of the regression model predictor. This facilitates both estimation and interpretability in high-dimensional settings. We identify appropriate default penalties that can also be treated as prior distribution assumptions in the Bayesian version of our network architecture. We consider several use-cases in experiments with synthetic data and real world applications to demonstrate the full efficacy of our approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2021

deepregression: a Flexible Neural Network Framework for Semi-Structured Deep Distributional Regression

This paper describes the implementation of semi-structured deep distribu...
research
10/14/2020

Neural Mixture Distributional Regression

We present neural mixture distributional regression (NMDR), a holistic f...
research
06/10/2021

An Interpretable Neural Network for Parameter Inference

Adoption of deep neural networks in fields such as economics or finance ...
research
08/16/2022

A unifying partially-interpretable framework for neural network-based extreme quantile regression

Risk management in many environmental settings requires an understanding...
research
08/22/2017

Nonparametric regression using deep neural networks with ReLU activation function

Consider the multivariate nonparametric regression model. It is shown th...
research
06/01/2023

A New PHO-rmula for Improved Performance of Semi-Structured Networks

Recent advances to combine structured regression models and deep neural ...
research
06/29/2023

Understanding Pathologies of Deep Heteroskedastic Regression

Several recent studies have reported negative results when using heteros...

Please sign up or login with your details

Forgot password? Click here to reset