End-to-end Learning of Cost-Volume Aggregation for Real-time Dense Stereo

11/17/2016
by   Andrey Kuzmin, et al.
0

We present a new deep learning-based approach for dense stereo matching. Compared to previous works, our approach does not use deep learning of pixel appearance descriptors, employing very fast classical matching scores instead. At the same time, our approach uses a deep convolutional network to predict the local parameters of cost volume aggregation process, which in this paper we implement using differentiable domain transform. By treating such transform as a recurrent neural network, we are able to train our whole system that includes cost volume computation, cost-volume aggregation (smoothing), and winner-takes-all disparity selection end-to-end. The resulting method is highly efficient at test time, while achieving good matching accuracy. On the KITTI 2015 benchmark, it achieves a result of 6.34% error rate while running at 29 frames per second rate on a modern GPU.

READ FULL TEXT

page 4

page 5

page 7

research
03/08/2019

Fast Deep Stereo with 2D Convolutional Processing of Cost Signatures

Modern neural network-based algorithms are able to produce highly accura...
research
01/12/2018

Deep Stereo Matching with Explicit Cost Aggregation Sub-Architecture

Deep neural networks have shown excellent performance for stereo matchin...
research
12/06/2016

Deep Stereo Matching with Dense CRF Priors

Stereo reconstruction from rectified images has recently been revisited ...
research
05/02/2019

DPSNet: End-to-end Deep Plane Sweep Stereo

Multiview stereo aims to reconstruct scene depth from images acquired by...
research
09/12/2019

DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch

Our goal is to significantly speed up the runtime of current state-of-th...
research
09/15/2014

Computing the Stereo Matching Cost with a Convolutional Neural Network

We present a method for extracting depth information from a rectified im...
research
05/25/2021

SRH-Net: Stacked Recurrent Hourglass Network for Stereo Matching

The cost aggregation strategy shows a crucial role in learning-based ste...

Please sign up or login with your details

Forgot password? Click here to reset