Neural Mixture Distributional Regression

10/14/2020
by   David Rügamer, et al.
8

We present neural mixture distributional regression (NMDR), a holistic framework to estimate complex finite mixtures of distributional regressions defined by flexible additive predictors. Our framework is able to handle a large number of mixtures of potentially different distributions in high-dimensional settings, allows for efficient and scalable optimization and can be applied to recent concepts that combine structured regression models with deep neural networks. While many existing approaches for mixture models address challenges in optimization of such and provide results for convergence under specific model assumptions, our approach is assumption-free and instead makes use of optimizers well-established in deep learning. Through extensive numerical experiments and a high-dimensional deep learning application we provide evidence that the proposed approach is competitive to existing approaches and works well in more complex scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2022

Mixture of Experts Distributional Regression: Implementation Using Robust Estimation with Adaptive First-order Methods

In this work, we propose an efficient implementation of mixtures of expe...
research
02/13/2020

A Unifying Network Architecture for Semi-Structured Deep Distributional Learning

We propose a unifying network architecture for deep distributional learn...
research
02/04/2023

mixdistreg: An R Package for Fitting Mixture of Experts Distributional Regression with Adaptive First-order Methods

This paper presents a high-level description of the R software package m...
research
04/06/2021

deepregression: a Flexible Neural Network Framework for Semi-Structured Deep Distributional Regression

This paper describes the implementation of semi-structured deep distribu...
research
05/03/2022

Scalable Regularised Joint Mixture Models

In many applications, data can be heterogeneous in the sense of spanning...
research
12/02/2019

A Random Matrix Perspective on Mixtures of Nonlinearities for Deep Learning

One of the distinguishing characteristics of modern deep learning system...
research
02/26/2021

Cholesky-based multivariate Gaussian regression

Multivariate Gaussian regression is embedded into a general distribution...

Please sign up or login with your details

Forgot password? Click here to reset