Constraining cosmological parameters from N-body simulations with Variational Bayesian Neural Networks

01/09/2023
by   Hector J. Hortua, et al.
0

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which have demonstrated to yield consistent posterior distribution into the parameter space, helpful for uncertainty quantification. However, as any modern neural networks, they tend to produce overly confident uncertainty estimates and can introduce bias when BNNs are applied to data. In this work, we implement multiplicative normalizing flows (MNFs), a family of approximate posteriors for the parameters of BNNs with the purpose of enhancing the flexibility of the variational posterior distribution, to extract Ω_m, h, and σ_8 from the QUIJOTE simulations. We have compared this method with respect to the standard BNNs, and the flipout estimator. We found that MNFs combined with BNNs outperform the other models obtaining predictive performance with almost one order of magnitude larger that standard BNNs, σ_8 extracted with high accuracy (r^2=0.99), and precise uncertainty estimates. The latter implies that MNFs provide more realistic predictive distribution closer to the true posterior mitigating the bias introduced by the variational approximation and allowing to work with well-calibrated networks.

READ FULL TEXT

page 1

page 10

page 12

research
05/05/2023

Sparsifying Bayesian neural networks with latent binary variables and normalizing flows

Artificial neural networks (ANNs) are powerful machine learning methods ...
research
09/01/2023

Bayesian deep learning for cosmic volumes with modified gravity

The new generation of galaxy surveys will provide unprecedented data all...
research
12/22/2021

Constraining cosmological parameters from N-body simulations with Bayesian Neural Networks

In this paper, we use The Quijote simulations in order to extract the co...
research
03/06/2017

Multiplicative Normalizing Flows for Variational Bayesian Neural Networks

We reinterpret multiplicative noise in neural networks as auxiliary rand...
research
10/24/2020

Implicit Variational Inference: the Parameter and the Predictor Space

Having access to accurate confidence levels along with the predictions a...
research
12/06/2019

Sampling-Free Learning of Bayesian Quantized Neural Networks

Bayesian learning of model parameters in neural networks is important in...
research
12/04/2020

Encoding the latent posterior of Bayesian Neural Networks for uncertainty quantification

Bayesian neural networks (BNNs) have been long considered an ideal, yet ...

Please sign up or login with your details

Forgot password? Click here to reset