Roto-Translation Equivariant Super-Resolution of Two-Dimensional Flows Using Convolutional Neural Networks

02/22/2022
by   Yuki Yasuda, et al.
0

Convolutional neural networks (CNNs) often process vectors as quantities having no direction like colors in images. This study investigates the effect of treating vectors as geometrical objects in terms of super-resolution of velocity on two-dimensional fluids. Vector is distinguished from scalar by the transformation law associated with a change in basis, which can be incorporated as the prior knowledge using the equivariant deep learning. We convert existing CNNs into equivariant ones by making each layer equivariant with respect to rotation and translation. The training data in the low- and high-resolution are generated with the downsampling or the spectral nudging. When the data inherit the rotational symmetry, the equivariant CNNs show comparable accuracy with the non-equivariant ones. Since the number of parameters is smaller in the equivariant CNNs, these models are trainable with a smaller size of the data. In this case, the transformation law of vector should be incorporated as the prior knowledge, where vector is explicitly treated as a quantity having direction. Two examples demonstrate that the symmetry of the data can be broken. In the first case, a downsampling method makes the correspondence between low- and high-resolution patterns dependent on the orientation. In the second case, the input data are insufficient to recognize the rotation of coordinates in the experiment with the spectral nudging. In both cases, the accuracy of the CNNs deteriorates if the equivariance is forced to be imposed, and the usage of conventional CNNs may be justified even though vector is processed as a quantity having no direction.

READ FULL TEXT

page 2

page 7

page 9

page 10

page 13

page 14

page 18

page 20

research
02/08/2018

Deep Image Super Resolution via Natural Image Priors

Single image super-resolution (SR) via deep learning has recently gained...
research
04/06/2020

Dense Steerable Filter CNNs for Exploiting Rotational Symmetry in Histology Images

Histology images are inherently symmetric under rotation, where each ori...
research
01/21/2020

Adaptive Loss Function for Super Resolution Neural Networks Using Convex Optimization Techniques

Single Image Super-Resolution (SISR) task refers to learn a mapping from...
research
06/07/2018

Super-Resolution using Convolutional Neural Networks without Any Checkerboard Artifacts

It is well-known that a number of excellent super-resolution (SR) method...
research
03/16/2018

Land cover mapping at very high resolution with rotation equivariant CNNs: towards small yet accurate models

In remote sensing images, the absolute orientation of objects is arbitra...
research
11/29/2019

Learning from Irregularly Sampled Data for Endomicroscopy Super-resolution: A Comparative Study of Sparse and Dense Approaches

Purpose: Probe-based Confocal Laser Endomicroscopy (pCLE) enables perfor...
research
03/24/2023

Factorizers for Distributed Sparse Block Codes

Distributed sparse block codes (SBCs) exhibit compact representations fo...

Please sign up or login with your details

Forgot password? Click here to reset