Deep attention-based classification network for robust depth prediction

07/11/2018
by   Ruibo Li, et al.
8

In this paper, we present our deep attention-based classification (DABC) network for robust single image depth prediction, in the context of the Robust Vision Challenge 2018 (ROB 2018). Unlike conventional depth prediction, our goal is to design a model that can perform well in both indoor and outdoor scenes with a single parameter set. However, robust depth prediction suffers from two challenging problems: a) How to extract more discriminative features for different scenes (compared to a single scene)? b) How to handle the large differences of depth ranges between indoor and outdoor datasets? To address these two problems, we first formulate depth prediction as a multi-class classification task and apply a softmax classifier to classify the depth label of each pixel. We then introduce a global pooling layer and a channel-wise attention mechanism to adaptively select the discriminative channels of features and to update the original features by assigning important channels with higher weights. Further, to reduce the influence of quantization errors, we employ a soft-weighted sum inference strategy for the final prediction. Experimental results on both indoor and outdoor datasets demonstrate the effectiveness of our method. It is worth mentioning that we won the 2-nd place in single image depth prediction entry of ROB 2018, in conjunction with IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.

READ FULL TEXT

page 2

page 10

page 11

page 13

page 14

research
06/07/2019

Deep Robust Single Image Depth Estimation Neural Network Using Scene Understanding

Single image depth estimation (SIDE) plays a crucial role in 3D computer...
research
08/01/2019

DIODE: A Dense Indoor and Outdoor DEpth Dataset

We introduce DIODE, a dataset that contains thousands of diverse high re...
research
11/04/2021

Towards Panoptic 3D Parsing for Single Image in the Wild

Performing single image holistic understanding and 3D reconstruction is ...
research
01/29/2019

Attention-based Context Aggregation Network for Monocular Depth Estimation

Depth estimation is a traditional computer vision task, which plays a cr...
research
04/03/2022

Distortion-Aware Self-Supervised 360° Depth Estimation from A Single Equirectangular Projection Image

360 images are widely available over the last few years. This paper prop...
research
12/15/2021

Consistent Depth Prediction under Various Illuminations using Dilated Cross Attention

In this paper, we aim to solve the problem of consistent depth predictio...
research
08/25/2022

Learning Continuous Implicit Representation for Near-Periodic Patterns

Near-Periodic Patterns (NPP) are ubiquitous in man-made scenes and are c...

Please sign up or login with your details

Forgot password? Click here to reset