Invertible Image Rescaling

05/12/2020
by   Mingqing Xiao, et al.
8

High-resolution digital images are usually downscaled to fit various display screens or save the cost of storage and bandwidth, meanwhile the post-upscaling is adpoted to recover the original resolutions or the details in the zoom-in images. However, typical image downscaling is a non-injective mapping due to the loss of high-frequency information, which leads to the ill-posed problem of the inverse upscaling procedure and poses great challenges for recovering details from the downscaled low-resolution images. Simply upscaling with image super-resolution methods results in unsatisfactory recovering performance. In this work, we propose to solve this problem by modeling the downscaling and upscaling processes from a new perspective, i.e. an invertible bijective transformation, which can largely mitigate the ill-posed nature of image upscaling. We develop an Invertible Rescaling Net (IRN) with deliberately designed framework and objectives to produce visually-pleasing low-resolution images and meanwhile capture the distribution of the lost information using a latent variable following a specified distribution in the downscaling process. In this way, upscaling is made tractable by inversely passing a randomly-drawn latent variable with the low-resolution image through the network. Experimental results demonstrate the significant improvement of our model over existing methods in terms of both quantitative and qualitative evaluations of image upscaling reconstruction from downscaled images.

READ FULL TEXT

page 12

page 13

page 22

page 23

page 24

page 25

page 26

page 27

07/24/2022

Enhancing Image Rescaling using Dual Latent Variables in Invertible Neural Network

Normalizing flow models have been used successfully for generative image...
04/18/2020

ImagePairs: Realistic Super Resolution Dataset via Beam Splitter Camera Rig

Super Resolution is the problem of recovering a high-resolution image fr...
11/21/2021

FreqNet: A Frequency-domain Image Super-Resolution Network with Dicrete Cosine Transform

Single image super-resolution(SISR) is an ill-posed problem that aims to...
06/22/2015

Adaptive Digital Scan Variable Pixels

The square and rectangular shape of the pixels in the digital images for...
06/22/2020

Modeling Lost Information in Lossy Image Compression

Lossy image compression is one of the most commonly used operators for d...
11/24/2021

LDP-Net: An Unsupervised Pansharpening Network Based on Learnable Degradation Processes

Pansharpening in remote sensing image aims at acquiring a high-resolutio...
01/29/2022

Scale-arbitrary Invertible Image Downscaling

Downscaling is indispensable when distributing high-resolution (HR) imag...

Code Repositories

Invertible-Image-Rescaling

Implementation of paper: Invertible Image Rescaling


view repo