Deep Reflection Prior

12/08/2019
by   Qingnan Fan, et al.
17

Reflections are very common phenomena in our daily photography, which distract people's attention from the scene behind the glass. The problem of removing reflection artifacts is important but challenging due to its ill-posed nature. Recent learning-based approaches have demonstrated a significant improvement in removing reflections. However, these methods are limited as they require a large number of synthetic reflection/clean image pairs for supervision, at the risk of overfitting in the synthetic image domain. In this paper, we propose a learning-based approach that captures the reflection statistical prior for single image reflection removal. Our algorithm is driven by optimizing the target with joint constraints enhanced between multiple input images during the training stage, but is able to eliminate reflections only from a single input for evaluation. Our framework allows to predict both background and reflection via a one-branch deep neural network, which is implemented by the controllable latent code that indicates either the background or reflection output. We demonstrate superior performance over the state-of-the-art methods on a large range of real-world images. We further provide insightful analysis behind the learned latent code, which may inspire more future work.

READ FULL TEXT

Authors

page 3

page 4

page 5

page 6

page 7

page 8

05/29/2018

Mirror, Mirror, on the Wall, Who's Got the Clearest Image of Them All? - A Tailored Approach to Single Image Reflection Removal

Removing reflection artefacts from a single-image is a problem of both t...
01/31/2018

Single Image Reflection Removal Using Deep Encoder-Decoder Network

Image of a scene captured through a piece of transparent and reflective ...
03/10/2019

Fast Single Image Reflection Suppression via Convex Optimization

Removing undesired reflections from images taken through the glass is of...
10/01/2020

Learned Dual-View Reflection Removal

Traditional reflection removal algorithms either use a single image as i...
01/22/2016

Depth and Reflection Total Variation for Single Image Dehazing

Haze removal has been a very challenging problem due to its ill-posednes...
04/26/2019

Single Image Reflection Removal with Physically-based Rendering

Recently, deep learning based single image reflection separation methods...
04/04/2022

Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspective

Recently, multiple synthetic and real-world datasets have been built to ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.