Bayesian Inference for Regression Copulas

07/10/2019
by   Michael Stanley Smith, et al.
0

We propose a new semi-parametric distributional regression smoother for continuous data, which is based on a copula decomposition of the joint distribution of the vector of response values. The copula is high-dimensional and constructed by inversion of a pseudo regression, where the conditional mean and variance are non-parametric functions of the covariates modeled using Bayesian splines. By integrating out the spline coefficients, we derive an implicit copula that captures dependence as a smooth non-parametric function of the covariates, which we call a regression copula. We derive some of its properties, and show that the entire distribution - including the mean and variance - of the response from the copula model are also smooth non-parametric functions of the covariates. Even though the implicit copula cannot be expressed in closed form, we estimate it efficiently using both Hamiltonian Monte Carlo and variational Bayes methods. Using four real data examples, we illustrate the efficacy of these estimators, and show the properties and advantages of the copula model, for implicit copulas of dimension up to 40,981. The approach produces predictive densities of the response that are locally adaptive with respect to the covariates, and are more accurate than those from benchmark methods in every case.

READ FULL TEXT

page 30

page 35

page 36

research
04/27/2018

Implicit Copulas from Bayesian Regularized Regression Smoothers

We show how to extract the implicit copula of a response vector from a B...
research
03/11/2023

Direct Bayesian Regression for Distribution-valued Covariates

In this manuscript, we study the problem of scalar-on-distribution regre...
research
06/29/2021

Isotonic regression for functionals of elicitation complexity greater than one

We study the non-parametric isotonic regression problem for bivariate el...
research
12/17/2018

Adaptive Non-parametric Estimation of Mean and Autocovariance in Regression with Dependent Errors

We develop a fully automatic non-parametric approach to simultaneous est...
research
04/09/2018

A Bayes-Sard Cubature Method

This paper focusses on the formulation of numerical integration as an in...
research
02/14/2020

An implicit function learning approach for parametric modal regression

For multi-valued functions—such as when the conditional distribution on ...
research
01/29/2023

P-values and e-values for non-parametric hypotheses with specified mean and variance

We build natural one-sided p-values and e-values for four types of non-p...

Please sign up or login with your details

Forgot password? Click here to reset