Learning an Astronomical Catalog of the Visible Universe through Scalable Bayesian Inference

11/10/2016
by   Jeffrey Regier, et al.
0

Celeste is a procedure for inferring astronomical catalogs that attains state-of-the-art scientific results. To date, Celeste has been scaled to at most hundreds of megabytes of astronomical images: Bayesian posterior inference is notoriously demanding computationally. In this paper, we report on a scalable, parallel version of Celeste, suitable for learning catalogs from modern large-scale astronomical datasets. Our algorithmic innovations include a fast numerical optimization routine for Bayesian posterior inference and a statistically efficient scheme for decomposing astronomical optimization problems into subproblems. Our scalable implementation is written entirely in Julia, a new high-level dynamic programming language designed for scientific and numerical computing. We use Julia's high-level constructs for shared and distributed memory parallelism, and demonstrate effective load balancing and efficient scaling on up to 8192 Xeon cores on the NERSC Cori supercomputer.

READ FULL TEXT

page 3

page 7

research
01/31/2018

Cataloging the Visible Universe through Bayesian Inference at Petascale

Astronomical catalogs derived from wide-field imaging surveys are an imp...
research
11/24/2014

Big Learning with Bayesian Methods

Explosive growth in data and availability of cheap computing resources h...
research
05/27/2020

Korali: a High-Performance Computing Framework for Stochastic Optimization and Bayesian Uncertainty Quantification

We present a modular, open-source, high-performance computing framework ...
research
12/21/2022

kalis: A Modern Implementation of the Li Stephens Model for Local Ancestry Inference in R

Approximating the recent phylogeny of N phased haplotypes at a set of va...
research
07/08/2019

Etalumis: Bringing Probabilistic Programming to Scientific Simulators at Scale

Probabilistic programming languages (PPLs) are receiving widespread atte...
research
12/22/2020

NetworkDynamics.jl – Composing and simulating complex networks in Julia

NetworkDynamics.jl is an easy-to-use and computationally efficient packa...
research
05/11/2018

Towards scalable pattern-based optimization for dense linear algebra

Linear algebraic expressions are the essence of many computationally int...

Please sign up or login with your details

Forgot password? Click here to reset