Bayesian dependent mixture models: A predictive comparison and survey

07/30/2023
by   Sara Wade, et al.
0

For exchangeable data, mixture models are an extremely useful tool for density estimation due to their attractive balance between smoothness and flexibility. When additional covariate information is present, mixture models can be extended for flexible regression by modeling the mixture parameters, namely the weights and atoms, as functions of the covariates. These types of models are interpretable and highly flexible, allowing non only the mean but the whole density of the response to change with the covariates, which is also known as density regression. This article reviews Bayesian covariate-dependent mixture models and highlights which data types can be accommodated by the different models along with the methodological and applied areas where they have been used. In addition to being highly flexible, these models are also numerous; we focus on nonparametric constructions and broadly organize them into three categories: 1) joint models of the responses and covariates, 2) conditional models with single-weights and covariate-dependent atoms, and 3) conditional models with covariate-dependent weights. The diversity and variety of the available models in the literature raises the question of how to choose among them for the application at hand. We attempt to shed light on this question through a careful analysis of the predictive equations for the conditional mean and density function as well as predictive comparisons in three simulated data examples.

READ FULL TEXT

page 1

page 21

page 24

page 26

page 27

research
05/26/2021

Flexible Bayesian modelling of concomitant covariate effects in mixture models

Mixture models provide a useful tool to account for unobserved heterogen...
research
12/08/2022

Strong identifiability and parameter learning in regression with heterogeneous response

Mixtures of regression are a powerful class of models for regression lea...
research
12/22/2021

Density Regression with Bayesian Additive Regression Trees

Flexibly modeling how an entire density changes with covariates is an im...
research
05/17/2019

Colombian Women's Life Patterns: A Multivariate Density Regression Approach

Women in Latin America and the Caribbean face difficulties related to th...
research
09/23/2021

Dynamic Mixture of Experts Models for Online Prediction

A mixture of experts models the conditional density of a response variab...
research
08/04/2022

Tree stick-breaking priors for covariate-dependent mixture models

Stick-breaking priors are often adopted in Bayesian nonparametric mixtur...
research
09/27/2012

Sparse Ising Models with Covariates

There has been a lot of work fitting Ising models to multivariate binary...

Please sign up or login with your details

Forgot password? Click here to reset