Geometry-based Occlusion-Aware Unsupervised Stereo Matching for Autonomous Driving

10/21/2020
by   Liang Peng, et al.
9

Recently, there are emerging many stereo matching methods for autonomous driving based on unsupervised learning. Most of them take advantage of reconstruction losses to remove dependency on disparity groundtruth. Occlusion handling is a challenging problem in stereo matching, especially for unsupervised methods. Previous unsupervised methods failed to take full advantage of geometry properties in occlusion handling. In this paper, we introduce an effective way to detect occlusion regions and propose a novel unsupervised training strategy to deal with occlusion that only uses the predicted left disparity map, by making use of its geometry features in an iterative way. In the training process, we regard the predicted left disparity map as pseudo groundtruth and infer occluded regions using geometry features. The resulting occlusion mask is then used in either training, post-processing, or both of them as guidance. Experiments show that our method could deal with the occlusion problem effectively and significantly outperforms the other unsupervised methods for stereo matching. Moreover, our occlusion-aware strategies can be extended to the other stereo methods conveniently and improve their performances.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 9

page 10

research
09/08/2021

Level Set Binocular Stereo with Occlusions

Localizing stereo boundaries and predicting nearby disparities are diffi...
research
08/26/2017

Stereo Matching With Color-Weighted Correlation, Hierarchical Belief Propagation And Occlusion Handling

In this paper, we contrive a stereo matching algorithm with careful hand...
research
07/17/2021

Co-Teaching: An Ark to Unsupervised Stereo Matching

Stereo matching is a key component of autonomous driving perception. Rec...
research
07/03/2018

SymmNet: A Symmetric Convolutional Neural Network for Occlusion Detection

Detecting the occlusion from stereo images or video frames is important ...
research
07/24/2020

A Lightweight Neural Network for Monocular View Generation with Occlusion Handling

In this article, we present a very lightweight neural network architectu...
research
01/12/2019

One-view occlusion detection for stereo matching with a fully connected CRF model

In this paper, we extend the standard belief propagation (BP) sequential...
research
03/05/2021

ES-Net: An Efficient Stereo Matching Network

Dense stereo matching with deep neural networks is of great interest to ...

Please sign up or login with your details

Forgot password? Click here to reset