Domain-invariant Stereo Matching Networks

11/29/2019
by   Feihu Zhang, et al.
4

State-of-the-art stereo matching networks have difficulties in generalizing to new unseen environments due to significant domain differences, such as color, illumination, contrast, and texture. In this paper, we aim at designing a domain-invariant stereo matching network (DSMNet) that generalizes well to unseen scenes. To achieve this goal, we propose i) a novel "domain normalization" approach that regularizes the distribution of learned representations to allow them to be invariant to domain differences, and ii) a trainable non-local graph-based filter for extracting robust structural and geometric representations that can further enhance domain-invariant generalizations. When trained on synthetic data and generalized to real test sets, our model performs significantly better than all state-of-the-art models. It even outperforms some deep learning models (e.g. MC-CNN) fine-tuned with test-domain data.

READ FULL TEXT

page 2

page 3

page 7

page 8

page 13

page 14

page 16

page 17

research
01/06/2022

ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networks

State-of-the-art stereo matching networks trained only on synthetic data...
research
04/09/2020

AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching

In this paper, we attempt to solve the domain adaptation problem for dee...
research
06/15/2021

Achieving Domain Robustness in Stereo Matching Networks by Removing Shortcut Learning

Learning-based stereo matching and depth estimation networks currently e...
research
02/10/2014

Binary Stereo Matching

In this paper, we propose a novel binary-based cost computation and aggr...
research
03/18/2018

Zoom and Learn: Generalizing Deep Stereo Matching to Novel Domains

Despite the recent success of stereo matching with convolutional neural ...
research
10/14/2020

Matching-space Stereo Networks for Cross-domain Generalization

End-to-end deep networks represent the state of the art for stereo match...
research
03/22/2022

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

With the advent of convolutional neural networks, stereo matching algori...

Please sign up or login with your details

Forgot password? Click here to reset