Pyramid Stereo Matching Network

03/23/2018
by   Jia-Ren Chang, et al.
0

Recent work has shown that depth estimation from a stereo pair of images can be formulated as a supervised learning task to be resolved with convolutional neural networks (CNNs). However, current architectures rely on patch-based Siamese networks, lacking the means to exploit context information for finding correspondence in illposed regions. To tackle this problem, we propose PSMNet, a pyramid stereo matching network consisting of two main modules: spatial pyramid pooling and 3D CNN. The spatial pyramid pooling module takes advantage of the capacity of global context information by aggregating context in different scales and locations to form a cost volume. The 3D CNN learns to regularize cost volume using stacked multiple hourglass networks in conjunction with intermediate supervision. The proposed approach was evaluated on several benchmark datasets. Our method ranked first in the KITTI 2012 and 2015 leaderboards before March 18, 2018. The codes of PSMNet are available at: https://github.com/JiaRenChang/PSMNet.

READ FULL TEXT

page 7

page 8

research
04/25/2019

Multi-scale Cross-form Pyramid Network for Stereo Matching

Stereo matching plays an indispensable part in autonomous driving, robot...
research
06/10/2019

Global Context for Convolutional Pose Machines

Convolutional Pose Machine is a popular neural network architecture for ...
research
10/04/2018

Learning Depth with Convolutional Spatial Propagation Network

Depth prediction is one of the fundamental problems in computer vision. ...
research
09/19/2017

Look Wider to Match Image Patches with Convolutional Neural Networks

When a human matches two images, the viewer has a natural tendency to vi...
research
11/24/2022

TemporalStereo: Efficient Spatial-Temporal Stereo Matching Network

We present TemporalStereo, a coarse-to-fine based online stereo matching...
research
08/22/2021

MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matching

Recent methods in stereo matching have continuously improved the accurac...
research
04/21/2020

NPF-MVSNet: Normal and Pyramid Feature Aided Unsupervised MVS Network

We proposed an unsupervised learning-based network, named NPF-MVSNet, fo...

Please sign up or login with your details

Forgot password? Click here to reset