Octree-based hierarchical sampling optimization for the volumetric super-resolution of scientific data

06/08/2023
by   Xinjie Wang, et al.
0

When introducing physics-constrained deep learning solutions to the volumetric super-resolution of scientific data, the training is challenging to converge and always time-consuming. We propose a new hierarchical sampling method based on octree to solve these difficulties. In our approach, scientific data is preprocessed before training, and a hierarchical octree-based data structure is built to guide sampling on the latent context grid. Each leaf node in the octree corresponds to an indivisible subblock of the volumetric data. The dimensions of the subblocks are different, making the number of sample points in each randomly cropped training data block to be adaptive. We reconstruct the octree at intervals according to loss distribution to perform the multi-stage training. With the Rayleigh-Bénard convection problem, we deploy our method to state-of-the-art models. We constructed adequate experiments to evaluate the training performance and model accuracy of our method. Experiments indicate that our sampling optimization improves the convergence performance of physics-constrained deep learning super-resolution solutions. Furthermore, the sample points and training time are significantly reduced with no drop in model accuracy. We also test our method in training tasks of other deep neural networks, and the results show our sampling optimization has extensive effectiveness and applicability. The code is publicly available at https://github.com/xinjiewang/octree-based_sampling.

READ FULL TEXT

page 4

page 8

research
08/08/2023

PSRFlow: Probabilistic Super Resolution with Flow-Based Models for Scientific Data

Although many deep-learning-based super-resolution approaches have been ...
research
09/07/2023

SRN-SZ: Deep Leaning-Based Scientific Error-bounded Lossy Compression with Super-resolution Neural Networks

The fast growth of computational power and scales of modern super-comput...
research
05/20/2022

Combining Contrastive and Supervised Learning for Video Super-Resolution Detection

Upscaled video detection is a helpful tool in multimedia forensics, but ...
research
09/16/2019

TextSR: Content-Aware Text Super-Resolution Guided by Recognition

Scene text recognition has witnessed rapid development with the advance ...
research
06/13/2022

RPLHR-CT Dataset and Transformer Baseline for Volumetric Super-Resolution from CT Scans

In clinical practice, anisotropic volumetric medical images with low thr...
research
11/11/2017

Latent Constrained Correlation Filter

Correlation filters are special classifiers designed for shift-invariant...
research
06/15/2019

Volumetric Isosurface Rendering with Deep Learning-Based Super-Resolution

Rendering an accurate image of an isosurface in a volumetric field typic...

Please sign up or login with your details

Forgot password? Click here to reset