Learned Dual-View Reflection Removal

10/01/2020
by   Simon Niklaus, et al.
5

Traditional reflection removal algorithms either use a single image as input, which suffers from intrinsic ambiguities, or use multiple images from a moving camera, which is inconvenient for users. We instead propose a learning-based dereflection algorithm that uses stereo images as input. This is an effective trade-off between the two extremes: the parallax between two views provides cues to remove reflections, and two views are easy to capture due to the adoption of stereo cameras in smartphones. Our model consists of a learning-based reflection-invariant flow model for dual-view registration, and a learned synthesis model for combining aligned image pairs. Because no dataset for dual-view reflection removal exists, we render a synthetic dataset of dual-views with and without reflections for use in training. Our evaluation on an additional real-world dataset of stereo pairs shows that our algorithm outperforms existing single-image and multi-image dereflection approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
08/11/2021

Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning

Many camera sensors use a dual-pixel (DP) design that operates as a rudi...
research
03/28/2020

Polarized Reflection Removal with Perfect Alignment in the Wild

We present a novel formulation to removing reflection from polarized ima...
research
12/08/2019

Deep Reflection Prior

Reflections are very common phenomena in our daily photography, which di...
research
12/13/2020

Location-aware Single Image Reflection Removal

This paper proposes a novel location-aware deep learning-based single im...
research
04/26/2020

Learning to Autofocus

Autofocus is an important task for digital cameras, yet current approach...
research
04/01/2019

Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements

Removing undesirable reflections from a single image captured through a ...
research
04/10/2019

DAVANet: Stereo Deblurring with View Aggregation

Nowadays stereo cameras are more commonly adopted in emerging devices su...

Please sign up or login with your details

Forgot password? Click here to reset