Look Wider to Match Image Patches with Convolutional Neural Networks

09/19/2017
by   Haesol Park, et al.
0

When a human matches two images, the viewer has a natural tendency to view the wide area around the target pixel to obtain clues of right correspondence. However, designing a matching cost function that works on a large window in the same way is difficult. The cost function is typically not intelligent enough to discard the information irrelevant to the target pixel, resulting in undesirable artifacts. In this paper, we propose a novel learn a stereo matching cost with a large-sized window. Unlike conventional pooling layers with strides, the proposed per-pixel pyramid-pooling layer can cover a large area without a loss of resolution and detail. Therefore, the learned matching cost function can successfully utilize the information from a large area without introducing the fattening effect. The proposed method is robust despite the presence of weak textures, depth discontinuity, illumination, and exposure difference. The proposed method achieves near-peak performance on the Middlebury benchmark.

READ FULL TEXT

page 1

page 4

research
09/15/2014

Computing the Stereo Matching Cost with a Convolutional Neural Network

We present a method for extracting depth information from a rectified im...
research
05/23/2021

Stereo Matching Based on Visual Sensitive Information

The area of computer vision is one of the most discussed topics amongst ...
research
03/23/2018

Pyramid Stereo Matching Network

Recent work has shown that depth estimation from a stereo pair of images...
research
06/27/2020

MTStereo 2.0: improved accuracy of stereo depth estimation withMax-trees

Efficient yet accurate extraction of depth from stereo image pairs is re...
research
12/19/2018

Removing rain streaks by a linear model

Removing rain streaks from a single image continues to draw attentions t...
research
07/24/2018

StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Prediction

This paper presents StereoNet, the first end-to-end deep architecture fo...
research
03/27/2020

On the Optimization Dynamics of Wide Hypernetworks

Recent results in the theoretical study of deep learning have shown that...

Please sign up or login with your details

Forgot password? Click here to reset