Single Image Reflection Separation with Perceptual Losses

06/14/2018
by   Xuaner Zhang, et al.
6

We present an approach to separating reflection from a single image. The approach uses a fully convolutional network trained end-to-end with losses that exploit low-level and high-level image information. Our loss function includes two perceptual losses: a feature loss from a visual perception network, and an adversarial loss that encodes characteristics of images in the transmission layers. We also propose a novel exclusion loss that enforces pixel-level layer separation. We create a dataset of real-world images with reflection and corresponding ground-truth transmission layers for quantitative evaluation and model training. We validate our method through comprehensive quantitative experiments and show that our approach outperforms state-of-the-art reflection removal methods in PSNR, SSIM, and perceptual user study. We also extend our method to two other image enhancement tasks to demonstrate the generality of our approach.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 8

research
11/15/2019

Single Image Reflection Removal through Cascaded Refinement

We address the problem of removing undesirable reflections from a single...
research
09/01/2020

Unsupervised Single-Image Reflection Separation Using Perceptual Deep Image Priors

Reflections often degrade the quality of the image by obstructing the ba...
research
08/11/2017

A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing

This paper proposes a deep neural network structure that exploits edge i...
research
01/12/2018

Generative Single Image Reflection Separation

Single image reflection separation is an ill-posed problem since two sce...
research
01/18/2020

Learning to See Analogies: A Connectionist Exploration

This dissertation explores the integration of learning and analogy-makin...
research
04/06/2022

Analysis of Different Losses for Deep Learning Image Colorization

Image colorization aims to add color information to a grayscale image in...
research
08/19/2023

Single Image Reflection Separation via Component Synergy

The reflection superposition phenomenon is complex and widely distribute...

Please sign up or login with your details

Forgot password? Click here to reset