Normalizing Flow as a Flexible Fidelity Objective for Photo-Realistic Super-resolution

11/05/2021
by   Andreas Lugmayr, et al.
11

Super-resolution is an ill-posed problem, where a ground-truth high-resolution image represents only one possibility in the space of plausible solutions. Yet, the dominant paradigm is to employ pixel-wise losses, such as L_1, which drive the prediction towards a blurry average. This leads to fundamentally conflicting objectives when combined with adversarial losses, which degrades the final quality. We address this issue by revisiting the L_1 loss and show that it corresponds to a one-layer conditional flow. Inspired by this relation, we explore general flows as a fidelity-based alternative to the L_1 objective. We demonstrate that the flexibility of deeper flows leads to better visual quality and consistency when combined with adversarial losses. We conduct extensive user studies for three datasets and scale factors, where our approach is shown to outperform state-of-the-art methods for photo-realistic super-resolution. Code and trained models will be available at: git.io/AdFlow

READ FULL TEXT

page 1

page 4

page 6

page 7

page 12

page 13

page 15

page 16

research
06/25/2020

SRFlow: Learning the Super-Resolution Space with Normalizing Flow

Super-resolution is an ill-posed problem, since it allows for multiple p...
research
04/09/2020

DeepSEE: Deep Disentangled Semantic Explorative Extreme Super-Resolution

Super-resolution (SR) is by definition ill-posed. There are infinitely m...
research
06/06/2021

Noise Conditional Flow Model for Learning the Super-Resolution Space

Fundamentally, super-resolution is ill-posed problem because a low-resol...
research
03/08/2020

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models

The primary aim of single-image super-resolution is to construct a high-...
research
05/15/2020

Enhancing Perceptual Loss with Adversarial Feature Matching for Super-Resolution

Single image super-resolution (SISR) is an ill-posed problem with an ind...
research
08/03/2020

Deep Photo Cropper and Enhancer

This paper introduces a new type of image enhancement problem. Compared ...
research
11/24/2022

Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimation

Single-image super-resolution (SISR) networks trained with perceptual an...

Please sign up or login with your details

Forgot password? Click here to reset