DISCO: Depth Inference from Stereo using Context

05/31/2019
by   Kunal Swami, et al.
0

Recent deep learning based approaches have outperformed classical stereo matching methods. However, current deep learning based end-to-end stereo matching methods adopt a generic encoder-decoder style network with skip connections. To limit computational requirement, many networks perform excessive down sampling, which results in significant loss of useful low-level information. Additionally, many network designs do not exploit the rich multi-scale contextual information. In this work, we address these aforementioned problems by carefully designing the network architecture to preserve required spatial information throughout the network, while at the same time achieve large effective receptive field to extract multiscale contextual information. For the first time, we create a synthetic disparity dataset reflecting real life images captured using a smartphone; this enables us to obtain state-of-the-art results on common real life images. The proposed model DISCO is pre-trained on the synthetic Scene Flow dataset and evaluated on popular benchmarks and our in-house dataset of challenging real life images. The proposed model outperforms existing state-of-the-art methods in terms of quality as well as quantitative metrics.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
04/19/2019

AMNet: Deep Atrous Multiscale Stereo Disparity Estimation Networks

In this paper, a new deep learning architecture for stereo disparity est...
research
03/23/2021

Stereo Object Matching Network

This paper presents a stereo object matching method that exploits both 2...
research
03/22/2022

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

With the advent of convolutional neural networks, stereo matching algori...
research
06/25/2019

End-to-End Learning of Multi-scale Convolutional Neural Network for Stereo Matching

Deep neural networks have shown excellent performance in stereo matching...
research
08/02/2017

A Learning-based Framework for Hybrid Depth-from-Defocus and Stereo Matching

Depth from defocus (DfD) and stereo matching are two most studied passiv...
research
02/20/2023

UAVStereo: A Multiple Resolution Dataset for Stereo Matching in UAV Scenarios

Stereo matching is a fundamental task for 3D scene reconstruction. Recen...
research
11/25/2022

MS-PS: A Multi-Scale Network for Photometric Stereo With a New Comprehensive Training Dataset

The photometric stereo (PS) problem consists in reconstructing the 3D-su...

Please sign up or login with your details

Forgot password? Click here to reset