Unsupervised Single-Image Reflection Separation Using Perceptual Deep Image Priors

09/01/2020
by   Suhong Kim, et al.
2

Reflections often degrade the quality of the image by obstructing the background scene. This is not desirable for everyday users, and it negatively impacts the performance of multimedia applications that process images with reflections. Most current methods for removing reflections utilize supervised-learning models. However, these models require an extensive number of image pairs to perform well, especially on natural images with reflection, which is difficult to achieve in practice. In this paper, we propose a novel unsupervised framework for single-image reflection separation. Instead of learning from a large dataset, we optimize the parameters of two cross-coupled deep convolutional networks on a target image to generate two exclusive background and reflection layers. In particular, we design a new architecture of the network to embed semantic features extracted from a pre-trained deep classification network, which gives more meaningful separation similar to human perception. Quantitative and qualitative results on commonly used datasets in the literature show that our method's performance is at least on par with the state-of-the-art supervised methods and, occasionally, better without requiring large training datasets. Our results also show that our method significantly outperforms the closest unsupervised method in the literature for removing reflections from single images.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 8

page 9

page 10

research
06/14/2018

Single Image Reflection Separation with Perceptual Losses

We present an approach to separating reflection from a single image. The...
research
01/31/2018

Single Image Reflection Removal Using Deep Encoder-Decoder Network

Image of a scene captured through a piece of transparent and reflective ...
research
04/26/2019

Single Image Reflection Removal with Physically-based Rendering

Recently, deep learning based single image reflection separation methods...
research
06/03/2019

Separate from Observation: Unsupervised Single Image Layer Separation

Unsupervised single image layer separation aims at extracting two layers...
research
03/10/2019

Fast Single Image Reflection Suppression via Convex Optimization

Removing undesired reflections from images taken through the glass is of...
research
12/02/2018

"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priors

Many seemingly unrelated computer vision tasks can be viewed as a specia...
research
01/12/2018

Generative Single Image Reflection Separation

Single image reflection separation is an ill-posed problem since two sce...

Please sign up or login with your details

Forgot password? Click here to reset