Dirichlet Process Mixtures of Generalized Linear Models

09/28/2009
by   Lauren A. Hannah, et al.
0

We propose Dirichlet Process mixtures of Generalized Linear Models (DP-GLM), a new method of nonparametric regression that accommodates continuous and categorical inputs, and responses that can be modeled by a generalized linear model. We prove conditions for the asymptotic unbiasedness of the DP-GLM regression mean function estimate. We also give examples for when those conditions hold, including models for compactly supported continuous distributions and a model with continuous covariates and categorical response. We empirically analyze the properties of the DP-GLM and why it provides better results than existing Dirichlet process mixture regression models. We evaluate DP-GLM on several data sets, comparing it to modern methods of nonparametric regression like CART, Bayesian trees and Gaussian processes. Compared to existing techniques, the DP-GLM provides a single model (and corresponding inference algorithms) that performs well in many regression settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2014

The supervised hierarchical Dirichlet process

We propose the supervised hierarchical Dirichlet process (sHDP), a nonpa...
research
11/05/2018

Mixture of generalized linear models: identifiability and applications

We consider finite mixtures of generalized linear models with binary out...
research
10/20/2020

A Comparative Study of Imputation Methods for Multivariate Ordinal Data

Missing data remains a very common problem in large datasets, including ...
research
10/11/2021

Nonparametric Functional Analysis of Generalized Linear Models Under Nonlinear Constraints

This article introduces a novel nonparametric methodology for Generalize...
research
05/01/2018

Modeling Risk and Return using Dirichlet Process Prior

In this paper, we showed that the no-arbitrage condition holds if the ma...
research
07/09/2023

Bayesian estimation of the Kullback-Leibler divergence for categorical sytems using mixtures of Dirichlet priors

In many applications in biology, engineering and economics, identifying ...
research
06/06/2018

Outcome identification in electronic health records using predictions from an enriched Dirichlet process mixture

We propose a novel semiparametric model for the joint distribution of a ...

Please sign up or login with your details

Forgot password? Click here to reset