Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution

05/07/2022
by   Xiaoqian Xu, et al.
0

Due to the sophisticated imaging process, an identical scene captured by different cameras could exhibit distinct imaging patterns, introducing distinct proficiency among the super-resolution (SR) models trained on images from different devices. In this paper, we investigate a novel and practical task coded cross-device SR, which strives to adapt a real-world SR model trained on the paired images captured by one camera to low-resolution (LR) images captured by arbitrary target devices. The proposed task is highly challenging due to the absence of paired data from various imaging devices. To address this issue, we propose an unsupervised domain adaptation mechanism for real-world SR, named Dual ADversarial Adaptation (DADA), which only requires LR images in the target domain with available real paired data from a source camera. DADA employs the Domain-Invariant Attention (DIA) module to establish the basis of target model training even without HR supervision. Furthermore, the dual framework of DADA facilitates an Inter-domain Adversarial Adaptation (InterAA) in one branch for two LR input images from two domains, and an Intra-domain Adversarial Adaptation (IntraAA) in two branches for an LR input image. InterAA and IntraAA together improve the model transferability from the source domain to the target. We empirically conduct experiments under six Real to Real adaptation settings among three different cameras, and achieve superior performance compared with existing state-of-the-art approaches. We also evaluate the proposed DADA to address the adaptation to the video camera, which presents a promising research topic to promote the wide applications of real-world super-resolution. Our source code is publicly available at https://github.com/lonelyhope/DADA.git.

READ FULL TEXT

page 1

page 2

page 7

page 8

research
11/18/2019

Frequency Separation for Real-World Super-Resolution

Most of the recent literature on image super-resolution (SR) assumes the...
research
06/18/2022

Camera Adaptation for Fundus-Image-Based CVD Risk Estimation

Recent studies have validated the association between cardiovascular dis...
research
04/02/2020

Unsupervised Real-world Image Super Resolution via Domain-distance Aware Training

These days, unsupervised super-resolution (SR) has been soaring due to i...
research
04/06/2019

Camera Lens Super-Resolution

Existing methods for single image super-resolution (SR) are typically ev...
research
03/16/2020

Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolution

Deep neural networks have exhibited promising performance in image super...
research
12/30/2019

Characteristic Regularisation for Super-Resolving Face Images

Existing facial image super-resolution (SR) methods focus mostly on impr...
research
07/25/2022

NeuriCam: Video Super-Resolution and Colorization Using Key Frames

We present NeuriCam, a key-frame video super-resolution and colorization...

Please sign up or login with your details

Forgot password? Click here to reset