Design Amortization for Bayesian Optimal Experimental Design

10/07/2022
by   Noble Kennamer, et al.
0

Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically well-justified) expected information gain (EIG); unfortunately however, under most circumstances the EIG is intractable to evaluate. In this work we build off of successful variational approaches, which optimize a parameterized variational model with respect to bounds on the EIG. Past work focused on learning a new variational model from scratch for each new design considered. Here we present a novel neural architecture that allows experimenters to optimize a single variational model that can estimate the EIG for potentially infinitely many designs. To further improve computational efficiency, we also propose to train the variational model on a significantly cheaper-to-evaluate lower bound, and show empirically that the resulting model provides an excellent guide for more accurate, but expensive to evaluate bounds on the EIG. We demonstrate the effectiveness of our technique on generalized linear models, a class of statistical models that is widely used in the analysis of controlled experiments. Experiments show that our method is able to greatly improve accuracy over existing approximation strategies, and achieve these results with far better sample efficiency.

READ FULL TEXT

page 10

page 11

research
03/13/2019

Variational Bayesian Optimal Experimental Design

Bayesian optimal experimental design (BOED) is a principled framework fo...
research
06/17/2023

Variational Sequential Optimal Experimental Design using Reinforcement Learning

We introduce variational sequential Optimal Experimental Design (vsOED),...
research
03/13/2019

Variational Estimators for Bayesian Optimal Experimental Design

Bayesian optimal experimental design (BOED) is a principled framework fo...
research
01/05/2018

Gauged Mini-Bucket Elimination for Approximate Inference

Computing the partition function Z of a discrete graphical model is a fu...
research
05/30/2015

Efficient Bayesian experimentation using an expected information gain lower bound

Experimental design is crucial for inference where limitations in the da...
research
10/29/2021

Bayesian Optimal Experimental Design for Simulator Models of Cognition

Bayesian optimal experimental design (BOED) is a methodology to identify...
research
04/01/2020

An approximate KLD based experimental design for models with intractable likelihoods

Data collection is a critical step in statistical inference and data sci...

Please sign up or login with your details

Forgot password? Click here to reset