Bayesian hierarchical stacking

01/22/2021
by   Yuling Yao, et al.
7

Stacking is a widely used model averaging technique that yields asymptotically optimal prediction among all linear averages. We show that stacking is most effective when the model predictive performance is heterogeneous in inputs, so that we can further improve the stacked mixture with a hierarchical model. With the input-varying yet partially-pooled model weights, hierarchical stacking improves average and conditional predictions. Our Bayesian formulation includes constant-weight (complete-pooling) stacking as a special case. We generalize to incorporate discrete and continuous inputs, other structured priors, and time-series and longitudinal data. We demonstrate on several applied problems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

02/10/2020

Hierarchical Gaussian Process Priors for Bayesian Neural Network Weights

Probabilistic neural networks are typically modeled with independent wei...
12/14/2021

Local Prediction Pools

We propose local prediction pools as a method for combining the predicti...
12/24/2019

Bayesian Aggregation

A general challenge in statistics is prediction in the presence of multi...
02/26/2018

Bayesian regional flood frequency analysis for large catchments

Regional flood frequency analysis is commonly applied in situations wher...
03/19/2022

Jackknife Partially Linear Model Averaging for the Conditional Quantile Prediction

Estimating the conditional quantile of the interested variable with resp...
06/24/2014

Combining predictions from linear models when training and test inputs differ

Methods for combining predictions from different models in a supervised ...
12/02/2020

Hierarchical spline for time series forecasting: An application to Naval ship engine failure rate

Predicting equipment failure is important because it could improve avail...

Code Repositories

hierarchical-stacking-code

code and demo for hierarchical stacking paper


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.