Multivariate Prediction Intervals for Random Forests

05/04/2022
by   Brendan Folie, et al.
0

Accurate uncertainty estimates can significantly improve the performance of iterative design of experiments, as in Sequential and Reinforcement learning. For many such problems in engineering and the physical sciences, the design task depends on multiple correlated model outputs as objectives and/or constraints. To better solve these problems, we propose a recalibrated bootstrap method to generate multivariate prediction intervals for bagged models and show that it is well-calibrated. We apply the recalibrated bootstrap to a simulated sequential learning problem with multiple objectives and show that it leads to a marked decrease in the number of iterations required to find a satisfactory candidate. This indicates that the recalibrated bootstrap could be a valuable tool for practitioners using machine learning to optimize systems with multiple competing targets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/17/2021

Centroid Approximation for Bootstrap

Bootstrap is a principled and powerful frequentist statistical tool for ...
research
06/15/2021

RFpredInterval: An R Package for Prediction Intervals with Random Forests and Boosted Forests

Like many predictive models, random forests provide a point prediction f...
research
11/18/2013

Confidence Intervals for Random Forests: The Jackknife and the Infinitesimal Jackknife

We study the variability of predictions made by bagged learners and rand...
research
03/13/2018

Multivariate Prediction Intervals for Photovoltaic Power Generation

The current literature in probabilistic forecasting is focused on quanti...
research
08/25/2017

Comparison of the h-index for Different Fields of Research Using Bootstrap Methodology

An important disadvantage of the h-index is that typically it cannot tak...
research
12/29/2021

Sequential Episodic Control

State of the art deep reinforcement learning algorithms are sample ineff...
research
06/08/2018

Randomized Prior Functions for Deep Reinforcement Learning

Dealing with uncertainty is essential for efficient reinforcement learni...

Please sign up or login with your details

Forgot password? Click here to reset