Learned Dual-View Reflection Removal

by   Simon Niklaus, et al.

Traditional reflection removal algorithms either use a single image as input, which suffers from intrinsic ambiguities, or use multiple images from a moving camera, which is inconvenient for users. We instead propose a learning-based dereflection algorithm that uses stereo images as input. This is an effective trade-off between the two extremes: the parallax between two views provides cues to remove reflections, and two views are easy to capture due to the adoption of stereo cameras in smartphones. Our model consists of a learning-based reflection-invariant flow model for dual-view registration, and a learned synthesis model for combining aligned image pairs. Because no dataset for dual-view reflection removal exists, we render a synthetic dataset of dual-views with and without reflections for use in training. Our evaluation on an additional real-world dataset of stereo pairs shows that our algorithm outperforms existing single-image and multi-image dereflection approaches.



There are no comments yet.


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8


Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning

Many camera sensors use a dual-pixel (DP) design that operates as a rudi...

Polarized Reflection Removal with Perfect Alignment in the Wild

We present a novel formulation to removing reflection from polarized ima...

Deep Reflection Prior

Reflections are very common phenomena in our daily photography, which di...

Location-aware Single Image Reflection Removal

This paper proposes a novel location-aware deep learning-based single im...

Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements

Removing undesirable reflections from a single image captured through a ...

Learning to Autofocus

Autofocus is an important task for digital cameras, yet current approach...

DAVANet: Stereo Deblurring with View Aggregation

Nowadays stereo cameras are more commonly adopted in emerging devices su...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.