DeepAI AI Chat
Log In Sign Up

Learning Deep Correspondence through Prior and Posterior Feature Constancy

by   Zhengfa Liang, et al.

Stereo matching algorithms usually consist of four steps, including matching cost calculation, matching cost aggregation, disparity calculation, and disparity refinement. Existing CNN-based methods only adopt CNN to solve parts of the four steps, or use different networks to deal with different steps, making them difficult to obtain the overall optimal solution. In this paper, we propose a network architecture to incorporate all steps of stereo matching. The network consists of three parts. The first part calculates the multi-scale shared features. The second part performs matching cost calculation, matching cost aggregation and disparity calculation to estimate the initial disparity using shared features. The initial disparity and the shared features are used to calculate the prior and posterior feature constancy. The initial disparity, the prior and posterior feature constancy are then fed to a sub-network to refine the initial disparity through a Bayesian inference process. The proposed method has been evaluated on the Scene Flow and KITTI datasets. It achieves the state-of-the-art performance on the KITTI 2012 and KITTI 2015 benchmarks while maintaining a very fast running time.


page 7

page 8


MSMD-Net: Deep Stereo Matching with Multi-scale and Multi-dimension Cost Volume

Deep end-to-end learning based stereo matching methods have achieved gre...

Adaptive Unimodal Cost Volume Filtering for Deep Stereo Matching

State-of-the-art deep learning based stereo matching approaches treat di...

Detect, Replace, Refine: Deep Structured Prediction For Pixel Wise Labeling

Pixel wise image labeling is an interesting and challenging problem with...

End-to-End Learning of Multi-scale Convolutional Neural Network for Stereo Matching

Deep neural networks have shown excellent performance in stereo matching...

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

Stereo matching is essential for robot navigation. However, the accuracy...

Fast Deep Stereo with 2D Convolutional Processing of Cost Signatures

Modern neural network-based algorithms are able to produce highly accura...

EdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matching

Recently convolutional neural network (CNN) promotes the development of ...