DeepAI AI Chat
Log In Sign Up

Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networks

by   Biyang Liu, et al.
Zhejiang University

Although convolution neural network based stereo matching architectures have made impressive achievements, there are still some limitations: 1) Convolutional Feature (CF) tends to capture appearance information, which is inadequate for accurate matching. 2) Due to the static filters, current convolution based disparity refinement modules often produce over-smooth results. In this paper, we present two schemes to address these issues, where some traditional wisdoms are integrated. Firstly, we introduce a pairwise feature for deep stereo matching networks, named LSP (Local Similarity Pattern). Through explicitly revealing the neighbor relationships, LSP contains rich structural information, which can be leveraged to aid CF for more discriminative feature description. Secondly, we design a dynamic self-reassembling refinement strategy and apply it to the cost distribution and the disparity map respectively. The former could be equipped with the unimodal distribution constraint to alleviate the over-smoothing problem, and the latter is more practical. The effectiveness of the proposed methods is demonstrated via incorporating them into two well-known basic architectures, GwcNet and GANet-deep. Experimental results on the SceneFlow and KITTI benchmarks show that our modules significantly improve the performance of the model.


page 1

page 3

page 5

page 6

page 7


Do End-to-end Stereo Algorithms Under-utilize Information?

Deep networks for stereo matching typically leverage 2D or 3D convolutio...

EdgeStereo: An Effective Multi-Task Learning Network for Stereo Matching and Edge Detection

Recently, leveraging on the development of end-to-end convolutional neur...

Shift Convolution Network for Stereo Matching

In this paper, we present Shift Convolution Network (ShiftConvNet) to pr...

Practical Deep Stereo (PDS): Toward applications-friendly deep stereo matching

End-to-end deep-learning networks recently demonstrated extremely good p...

Adaptive Deconvolution-based stereo matching Net for Local Stereo Matching

In deep learning-based local stereo matching methods, larger image patch...

AdaStereo: An Efficient Domain-Adaptive Stereo Matching Approach

Recently, records on stereo matching benchmarks are constantly broken by...