WPPNets: Unsupervised CNN Training with Wasserstein Patch Priors for Image Superresolution

01/20/2022
by   Fabian Altekrüger, et al.
13

We introduce WPPNets, which are CNNs trained by a new unsupervised loss function for image superresolution of materials microstructures. Instead of requiring access to a large database of registered high- and low-resolution images, we only assume to know a large database of low resolution images, the forward operator and one high-resolution reference image. Then, we propose a loss function based on the Wasserstein patch prior which measures the Wasserstein-2 distance between the patch distributions of the predictions and the reference image. We demonstrate by numerical examples that WPPNets outperform other methods with similar assumptions. In particular, we show that WPPNets are much more stable under inaccurate knowledge or perturbations of the forward operator. This enables us to use them in real-world applications, where neither a large database of registered data nor the exact forward operator are given.

READ FULL TEXT

page 13

page 14

page 16

page 17

page 19

page 21

page 23

page 26

research
09/27/2021

Wasserstein Patch Prior for Image Superresolution

In this paper, we introduce a Wasserstein patch prior for superresolutio...
research
04/09/2019

Label Super Resolution with Inter-Instance Loss

For the task of semantic segmentation, high-resolution (pixel-level) gro...
research
01/25/2021

Proba-V-ref: Repurposing the Proba-V challenge for reference-aware super resolution

The PROBA-V Super-Resolution challenge distributes real low-resolution i...
research
06/03/2018

Patch-Based Image Hallucination for Super Resolution with Detail Reconstruction from Similar Sample Images

Image hallucination and super-resolution have been studied for decades, ...
research
03/06/2017

Learning across scales - A multiscale method for Convolution Neural Networks

In this work we establish the relation between optimal control and train...
research
06/13/2019

S3: A Spectral-Spatial Structure Loss for Pan-Sharpening Networks

Recently, many deep-learning-based pan-sharpening methods have been prop...
research
07/05/2018

Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders

Convolutional autoencoders have emerged as popular models for unsupervis...

Please sign up or login with your details

Forgot password? Click here to reset