DeepAI AI Chat
Log In Sign Up

Style-based Variational Autoencoder for Real-World Super-Resolution

12/21/2019
by   Xin Ma, et al.
ia.ac.cn
31

Real-world image super-resolution is a challenging image translation problem. Low-resolution (LR) images are often generated by various unknown transformations rather than by applying simple bilinear down-sampling on HR images. To address this issue, this paper proposes a novel Style-based Super-Resolution Variational Autoencoder network (SSRVAE) that contains a style Variational Autoencoder (styleVAE) and a SR Network. To get realistic real-world low-quality images paired with the HR images, we design a styleVAE to transfer the complex nuisance factors in real-world LR images to the generated LR images. We also use mutual information estimation (MI) to get better style information. For our SR network, we firstly propose a global attention residual block to learn long-range dependencies in images. Then another local attention residual block is proposed to enforce the attention of SR network moves to local areas of images in which texture detail will be filled. It is worth noticing that styleVAE is presented in a plug-and-play manner and thus can help to promote the generalization and robustness of our SR method as well as other SR methods. Extensive experiments demonstrate that our SSRVAE surpasses the state-of-the-art methods, both quantitatively and qualitatively.

READ FULL TEXT

page 1

page 4

page 6

page 7

06/08/2021

Variational AutoEncoder for Reference based Image Super-Resolution

In this paper, we propose a novel reference based image super-resolution...
09/08/2021

Toward Real-World Super-Resolution via Adaptive Downsampling Models

Most image super-resolution (SR) methods are developed on synthetic low-...
07/06/2020

Benefitting from Bicubically Down-Sampled Images for Learning Real-World Image Super-Resolution

Super-resolution (SR) has traditionally been based on pairs of high-reso...
12/15/2022

DCS-RISR: Dynamic Channel Splitting for Efficient Real-world Image Super-Resolution

Real-world image super-resolution (RISR) has received increased focus fo...
10/09/2022

Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images

Rendering high-resolution (HR) graphics brings substantial computational...
04/02/2022

Single Image Internal Distribution Measurement Using Non-Local Variational Autoencoder

Deep learning-based super-resolution methods have shown great promise, e...
05/07/2022

Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution

Due to the sophisticated imaging process, an identical scene captured by...

Code Repositories

face-hallucination

Can we perform face hallucination using limited set of unaligned pairs?


view repo