DeepAI
Log In Sign Up

Active-Passive SimStereo – Benchmarking the Cross-Generalization Capabilities of Deep Learning-based Stereo Methods

09/17/2022
by   Laurent Jospin, et al.
3

In stereo vision, self-similar or bland regions can make it difficult to match patches between two images. Active stereo-based methods mitigate this problem by projecting a pseudo-random pattern on the scene so that each patch of an image pair can be identified without ambiguity. However, the projected pattern significantly alters the appearance of the image. If this pattern acts as a form of adversarial noise, it could negatively impact the performance of deep learning-based methods, which are now the de-facto standard for dense stereo vision. In this paper, we propose the Active-Passive SimStereo dataset and a corresponding benchmark to evaluate the performance gap between passive and active stereo images for stereo matching algorithms. Using the proposed benchmark and an additional ablation study, we show that the feature extraction and matching modules of a selection of twenty selected deep learning-based stereo matching methods generalize to active stereo without a problem. However, the disparity refinement modules of three of the twenty architectures (ACVNet, CascadeStereo, and StereoNet) are negatively affected by the active stereo patterns due to their reliance on the appearance of the input images.

READ FULL TEXT

page 2

page 4

page 5

page 9

page 10

page 16

page 19

page 20

09/12/2022

Bayesian Learning for Disparity Map Refinement for Semi-Dense Active Stereo Vision

A major focus of recent developments in stereo vision has been on how to...
03/30/2020

Active stereo vision three-dimensional reconstruction by RGB dot pattern projection and ray intersection

Active stereo vision is important in reconstructing objects without obvi...
12/02/2021

Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networks

Although convolution neural network based stereo matching architectures ...
01/13/2020

Deep Learning Stereo Vision at the edge

We present an overview of the methodology used to build a new stereo vis...
12/14/2016

UnrealStereo: A Synthetic Dataset for Analyzing Stereo Vision

Stereo algorithm is important for robotics applications, such as quadcop...
11/01/2017

Widening siamese architectures for stereo matching

Computational stereo is one of the classical problems in computer vision...
02/06/2017

Conceptual and algorithmic development of Pseudo 3D Graphics and Video Content Visualization

The article presents a general concept of the organization of pseudo thr...