Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks

07/18/2022
by   Pablo Lemos, et al.
16

Simulation-based inference (SBI) is rapidly establishing itself as a standard machine learning technique for analyzing data in cosmological surveys. Despite continual improvements to the quality of density estimation by learned models, applications of such techniques to real data are entirely reliant on the generalization power of neural networks far outside the training distribution, which is mostly unconstrained. Due to the imperfections in scientist-created simulations, and the large computational expense of generating all possible parameter combinations, SBI methods in cosmology are vulnerable to such generalization issues. Here, we discuss the effects of both issues, and show how using a Bayesian neural network framework for training SBI can mitigate biases, and result in more reliable inference outside the training set. We introduce cosmoSWAG, the first application of Stochastic Weight Averaging to cosmology, and apply it to SBI trained for inference on the cosmic microwave background.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2021

Robust and integrative Bayesian neural networks for likelihood-free parameter inference

State-of-the-art neural network-based methods for learning summary stati...
research
06/28/2023

BayesFlow: Amortized Bayesian Workflows With Neural Networks

Modern Bayesian inference involves a mixture of computational techniques...
research
11/07/2018

Bayesian State Estimation for Unobservable Distribution Systems via Deep Learning

The problem of state estimation for unobservable distribution systems is...
research
11/11/2022

Understanding Approximation for Bayesian Inference in Neural Networks

Bayesian inference has theoretical attractions as a principled framework...
research
05/08/2020

Amortized Bayesian Inference for Models of Cognition

As models of cognition grow in complexity and number of parameters, Baye...
research
05/09/2020

Generalizing Outside the Training Set: When Can Neural Networks Learn Identity Effects?

Often in language and other areas of cognition, whether two components o...
research
02/15/2017

Robust Stochastic Configuration Networks with Kernel Density Estimation

Neural networks have been widely used as predictive models to fit data d...

Please sign up or login with your details

Forgot password? Click here to reset