Realistic galaxy image simulation via score-based generative models

11/02/2021
by   Michael J. Smith, et al.
0

We show that a Denoising Diffusion Probabalistic Model (DDPM), a class of score-based generative model, can be used to produce realistic yet fake images that mimic observations of galaxies. Our method is tested with Dark Energy Spectroscopic Instrument grz imaging of galaxies from the Photometry and Rotation curve OBservations from Extragalactic Surveys (PROBES) sample and galaxies selected from the Sloan Digital Sky Survey. Subjectively, the generated galaxies are highly realistic when compared with samples from the real dataset. We quantify the similarity by borrowing from the deep generative learning literature, using the `Fréchet Inception Distance' to test for subjective and morphological similarity. We also introduce the `Synthetic Galaxy Distance' metric to compare the emergent physical properties (such as total magnitude, colour and half light radius) of a ground truth parent and synthesised child dataset. We argue that the DDPM approach produces sharper and more realistic images than other generative methods such as Adversarial Networks (with the downside of more costly inference), and could be used to produce large samples of synthetic observations tailored to a specific imaging survey. We demonstrate two potential uses of the DDPM: (1) accurate in-painting of occluded data, such as satellite trails, and (2) domain transfer, where new input images can be processed to mimic the properties of the DDPM training set. Here we `DESI-fy' cartoon images as a proof of concept for domain transfer. Finally, we suggest potential applications for score-based approaches that could motivate further research on this topic within the astronomical community.

READ FULL TEXT

page 3

page 4

page 5

page 7

page 8

research
06/05/2023

Brain tumor segmentation using synthetic MR images – A comparison of GANs and diffusion models

Large annotated datasets are required for training deep learning models,...
research
11/13/2020

Survey2Survey: A deep learning generative model approach for cross-survey image mapping

During the last decade, there has been an explosive growth in survey dat...
research
05/26/2019

Classification Accuracy Score for Conditional Generative Models

Deep generative models (DGMs) of images are now sufficiently mature that...
research
11/22/2022

Can denoising diffusion probabilistic models generate realistic astrophysical fields?

Score-based generative models have emerged as alternatives to generative...
research
04/07/2022

PetroGAN: A novel GAN-based approach to generate realistic, label-free petrographic datasets

Deep learning architectures have enriched data analytics in the geoscien...
research
06/24/2023

Score-based Generative Models for Photoacoustic Image Reconstruction with Rotation Consistency Constraints

Photoacoustic tomography (PAT) is a newly emerged imaging modality which...
research
04/14/2022

Ensuring accurate stain reproduction in deep generative networks for virtual immunohistochemistry

Immunohistochemistry is a valuable diagnostic tool for cancer pathology....

Please sign up or login with your details

Forgot password? Click here to reset