A Multi-Pass GAN for Fluid Flow Super-Resolution

by   Maximilian Werhahn, et al.

We propose a novel method to up-sample volumetric functions with generative neural networks using several orthogonal passes. Our method decomposes generative problems on Cartesian field functions into multiple smaller sub-problems that can be learned more efficiently. Specifically, we utilize two separate generative adversarial networks: the first one up-scales slices which are parallel to the XY-plane, whereas the second one refines the whole volume along the Z-axis working on slices in the YZ-plane. In this way, we obtain full coverage for the 3D target function and can leverage spatio-temporal supervision with a set of discriminators. Additionally, we demonstrate that our method can be combined with curriculum learning and progressive growing approaches. We arrive at a first method that can up-sample volumes by a factor of eight along each dimension, i.e., increasing the number of degrees of freedom by 512. Large volumetric up-scaling factors such as this one have previously not been attainable as the required number of weights in the neural networks renders adversarial training runs prohibitively difficult. We demonstrate the generality of our trained networks with a series of comparisons to previous work, a variety of complex 3D results, and an analysis of the resulting performance.


page 1

page 4

page 5

page 6

page 7

page 8

page 9


Anisotropic Super Resolution in Prostate MRI using Super Resolution Generative Adversarial Networks

Acquiring High Resolution (HR) Magnetic Resonance (MR) images requires t...

tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow

We propose a temporally coherent generative model addressing the super-r...

iSeeBetter: Spatio-temporal video super-resolution using recurrent generative back-projection networks

Recently, learning-based models have enhanced the performance of single-...

Temporally Coherent GANs for Video Super-Resolution (TecoGAN)

Adversarial training has been highly successful in the context of image ...

Using Physics-Informed Super-Resolution Generative Adversarial Networks for Subgrid Modeling in Turbulent Reactive Flows

Turbulence is still one of the main challenges for accurately predicting...

Using the Order of Tomographic Slices as a Prior for Neural Networks Pre-Training

The technical advances in Computed Tomography (CT) allow to obtain immen...

Coding of volumetric content with MIV using VVC subpictures

Storage and transport of six degrees of freedom (6DoF) dynamic volumetri...

Please sign up or login with your details

Forgot password? Click here to reset