Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescaling

08/11/2021
by   Jingyun Liang, et al.
0

Normalizing flows have recently demonstrated promising results for low-level vision tasks. For image super-resolution (SR), it learns to predict diverse photo-realistic high-resolution (HR) images from the low-resolution (LR) image rather than learning a deterministic mapping. For image rescaling, it achieves high accuracy by jointly modelling the downscaling and upscaling processes. While existing approaches employ specialized techniques for these two tasks, we set out to unify them in a single formulation. In this paper, we propose the hierarchical conditional flow (HCFlow) as a unified framework for image SR and image rescaling. More specifically, HCFlow learns a bijective mapping between HR and LR image pairs by modelling the distribution of the LR image and the rest high-frequency component simultaneously. In particular, the high-frequency component is conditional on the LR image in a hierarchical manner. To further enhance the performance, other losses such as perceptual loss and GAN loss are combined with the commonly used negative log-likelihood loss in training. Extensive experiments on general image SR, face image SR and image rescaling have demonstrated that the proposed HCFlow achieves state-of-the-art performance in terms of both quantitative metrics and visual quality.

READ FULL TEXT

page 7

page 8

research
06/25/2020

SRFlow: Learning the Super-Resolution Space with Normalizing Flow

Super-resolution is an ill-posed problem, since it allows for multiple p...
research
01/20/2017

Dual Recovery Network with Online Compensation for Image Super-Resolution

The image super-resolution (SR) methods will essentially lead to a loss ...
research
09/19/2018

Dual Reconstruction Nets for Image Super-Resolution with Gradient Sensitive Loss

Deep neural networks have exhibited promising performance in image super...
research
03/09/2023

Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution

Flow-based methods have demonstrated promising results in addressing the...
research
03/12/2023

Raising The Limit Of Image Rescaling Using Auxiliary Encoding

Normalizing flow models using invertible neural networks (INN) have been...
research
07/16/2022

Stochastic Attribute Modeling for Face Super-Resolution

When a high-resolution (HR) image is degraded into a low-resolution (LR)...
research
03/06/2021

ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic

We aim at accelerating super-resolution (SR) networks on large images (2...

Please sign up or login with your details

Forgot password? Click here to reset