Meta-learning Control Variates: Variance Reduction with Limited Data

03/08/2023
by   Zhuo Sun, et al.
0

Control variates can be a powerful tool to reduce the variance of Monte Carlo estimators, but constructing effective control variates can be challenging when the number of samples is small. In this paper, we show that when a large number of related integrals need to be computed, it is possible to leverage the similarity between these integration tasks to improve performance even when the number of samples per task is very small. Our approach, called meta learning CVs (Meta-CVs), can be used for up to hundreds or thousands of tasks. Our empirical assessment indicates that Meta-CVs can lead to significant variance reduction in such settings, and our theoretical analysis establishes general conditions under which Meta-CVs can be successfully trained.

READ FULL TEXT
research
09/18/2021

Vector-Valued Control Variates

Control variates are post-processing tools for Monte Carlo estimators wh...
research
06/01/2018

Neural Control Variates for Variance Reduction

In statistics and machine learning, approximation of an intractable inte...
research
08/30/2018

Towards Reproducible Empirical Research in Meta-Learning

Meta-learning is increasingly used to support the recommendation of mach...
research
01/18/2023

Meta variance reduction for Monte Carlo estimation of energetic particle confinement during stellarator optimization

This work introduces meta estimators that combine multiple multifidelity...
research
03/02/2023

A Meta-Learning Approach to Predicting Performance and Data Requirements

We propose an approach to estimate the number of samples required for a ...
research
11/20/2020

Meta Variational Monte Carlo

An identification is found between meta-learning and the problem of dete...
research
02/20/2020

Meta-learning for mixed linear regression

In modern supervised learning, there are a large number of tasks, but ma...

Please sign up or login with your details

Forgot password? Click here to reset