AWNet: Attentive Wavelet Network for Image ISP

08/20/2020
by   Linhui Dai, et al.
33

As the revolutionary improvement being made on the performance of smartphones over the last decade, mobile photography becomes one of the most common practices among the majority of smartphone users. However, due to the limited size of camera sensors on phone, the photographed image is still visually distinct to the one taken by the digital single-lens reflex (DSLR) camera. To narrow this performance gap, one is to redesign the camera image signal processor (ISP) to improve the image quality. Owing to the rapid rise of deep learning, recent works resort to the deep convolutional neural network (CNN) to develop a sophisticated data-driven ISP that directly maps the phone-captured image to the DSLR-captured one. In this paper, we introduce a novel network that utilizes the attention mechanism and wavelet transform, dubbed AWNet, to tackle this learnable image ISP problem. By adding the wavelet transform, our proposed method enables us to restore favorable image details from RAW information and achieve a larger receptive field while remaining high efficiency in terms of computational cost. The global context block is adopted in our method to learn the non-local color mapping for the generation of appealing RGB images. More importantly, this block alleviates the influence of image misalignment occurred on the provided dataset. Experimental results indicate the advances of our design in both qualitative and quantitative measurements.

READ FULL TEXT

page 2

page 11

page 13

research
03/20/2022

Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wild

We propose a trainable Image Signal Processing (ISP) framework that prod...
research
04/08/2017

DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks

Despite a rapid rise in the quality of built-in smartphone cameras, thei...
research
05/18/2018

Multi-level Wavelet-CNN for Image Restoration

The tradeoff between receptive field size and efficiency is a crucial is...
research
09/25/2017

Camera-Aware Multi-Resolution Analysis (CAMRA) for Raw Sensor Data Compression

We propose a novel lossless and lossy compression scheme for color filte...
research
07/31/2017

Wavelet Residual Network for Low-Dose CT via Deep Convolutional Framelets

Model based iterative reconstruction (MBIR) algorithms for low-dose X-ra...
research
05/17/2021

Fast and Accurate Quantized Camera Scene Detection on Smartphones, Mobile AI 2021 Challenge: Report

Camera scene detection is among the most popular computer vision problem...
research
03/20/2022

CRISPnet: Color Rendition ISP Net

Image signal processors (ISPs) are historically grown legacy software sy...

Please sign up or login with your details

Forgot password? Click here to reset