RockGPT: Reconstructing three-dimensional digital rocks from single two-dimensional slice from the perspective of video generation

08/05/2021
by   Qiang Zheng, et al.
0

Random reconstruction of three-dimensional (3D) digital rocks from two-dimensional (2D) slices is crucial for elucidating the microstructure of rocks and its effects on pore-scale flow in terms of numerical modeling, since massive samples are usually required to handle intrinsic uncertainties. Despite remarkable advances achieved by traditional process-based methods, statistical approaches and recently famous deep learning-based models, few works have focused on producing several kinds of rocks with one trained model and allowing the reconstructed samples to satisfy certain given properties, such as porosity. To fill this gap, we propose a new framework, named RockGPT, which is composed of VQ-VAE and conditional GPT, to synthesize 3D samples based on a single 2D slice from the perspective of video generation. The VQ-VAE is utilized to compress high-dimensional input video, i.e., the sequence of continuous rock slices, to discrete latent codes and reconstruct them. In order to obtain diverse reconstructions, the discrete latent codes are modeled using conditional GPT in an autoregressive manner, while incorporating conditional information from a given slice, rock type, and porosity. We conduct two experiments on five kinds of rocks, and the results demonstrate that RockGPT can produce different kinds of rocks with the same model, and the reconstructed samples can successfully meet certain specified porosities. In a broader sense, through leveraging the proposed conditioning scheme, RockGPT constitutes an effective way to build a general model to produce multiple kinds of rocks simultaneously that also satisfy user-defined properties.

READ FULL TEXT

page 11

page 15

page 22

research
01/29/2019

Reconstruction of 3D Porous Media From 2D Slices

We propose a novel deep learning architecture for three-dimensional poro...
research
07/09/2020

Modelling the Distribution of 3D Brain MRI using a 2D Slice VAE

Probabilistic modelling has been an essential tool in medical image anal...
research
12/06/2016

Learning Diverse Image Colorization

Colorization is an ambiguous problem, with multiple viable colorizations...
research
04/28/2020

Convolutional Neural Networks vs. Deformable Image Registration For Medical Slice Interpolation

Medical image slice interpolation is an active field of research. The me...
research
06/22/2020

Hierarchical Patch VAE-GAN: Generating Diverse Videos from a Single Sample

We consider the task of generating diverse and novel videos from a singl...
research
10/04/2019

Conditional out-of-sample generation for unpaired data using trVAE

While generative models have shown great success in generating high-dime...

Please sign up or login with your details

Forgot password? Click here to reset