Self-Adaptively Learning to Demoire from Focused and Defocused Image Pairs

11/03/2020
by   Lin Liu, et al.
2

Moire artifacts are common in digital photography, resulting from the interference between high-frequency scene content and the color filter array of the camera. Existing deep learning-based demoireing methods trained on large scale datasets are limited in handling various complex moire patterns, and mainly focus on demoireing of photos taken of digital displays. Moreover, obtaining moire-free ground-truth in natural scenes is difficult but needed for training. In this paper, we propose a self-adaptive learning method for demoireing a high-frequency image, with the help of an additional defocused moire-free blur image. Given an image degraded with moire artifacts and a moire-free blur image, our network predicts a moire-free clean image and a blur kernel with a self-adaptive strategy that does not require an explicit training stage, instead performing test-time adaptation. Our model has two sub-networks and works iteratively. During each iteration, one sub-network takes the moire image as input, removing moire patterns and restoring image details, and the other sub-network estimates the blur kernel from the blur image. The two sub-networks are jointly optimized. Extensive experiments demonstrate that our method outperforms state-of-the-art methods and can produce high-quality demoired results. It can generalize well to the task of removing moire artifacts caused by display screens. In addition, we build a new moire dataset, including images with screen and texture moire artifacts. As far as we know, this is the first dataset with real texture moire patterns.

READ FULL TEXT

page 5

page 8

page 13

page 14

page 15

page 16

page 17

page 18

research
01/18/2023

FPANet: Frequency-based Video Demoireing using Frame-level Post Alignment

Interference between overlapping gird patterns creates moire patterns, d...
research
11/19/2019

Deep Motion Blur Removal Using Noisy/Blurry Image Pairs

Removing spatially variant motion blur from a blurry image is a challeng...
research
08/28/2019

Self-supervised blur detection from synthetically blurred scenes

Blur detection aims at segmenting the blurred areas of a given image. Re...
research
11/15/2021

Recursive Self-Improvement for Camera Image and Signal Processing Pipeline

Current camera image and signal processing pipelines (ISPs), including d...
research
02/11/2023

Removing Image Artifacts From Scratched Lens Protectors

A protector is placed in front of the camera lens for mobile devices to ...
research
01/27/2020

Handling noise in image deblurring via joint learning

Currently, many blind deblurring methods assume blurred images are noise...
research
06/21/2022

Deep Metric Color Embeddings for Splicing Localization in Severely Degraded Images

One common task in image forensics is to detect spliced images, where mu...

Please sign up or login with your details

Forgot password? Click here to reset