Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimation

03/29/2018
by   Dan Xu, et al.
0

Recent works have shown the benefit of integrating Conditional Random Fields (CRFs) models into deep architectures for improving pixel-level prediction tasks. Following this line of research, in this paper we introduce a novel approach for monocular depth estimation. Similarly to previous works, our method employs a continuous CRF to fuse multi-scale information derived from different layers of a front-end Convolutional Neural Network (CNN). Differently from past works, our approach benefits from a structured attention model which automatically regulates the amount of information transferred between corresponding features at different scales. Importantly, the proposed attention model is seamlessly integrated into the CRF, allowing end-to-end training of the entire architecture. Our extensive experimental evaluation demonstrates the effectiveness of the proposed method which is competitive with previous methods on the KITTI benchmark and outperforms the state of the art on the NYU Depth V2 dataset.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
03/01/2018

Monocular Depth Estimation using Multi-Scale Continuous CRFs as Sequential Deep Networks

Depth cues have been proved very useful in various computer vision and r...
research
04/07/2017

Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation

This paper addresses the problem of depth estimation from a single still...
research
01/08/2021

Probabilistic Graph Attention Network with Conditional Kernels for Pixel-Wise Prediction

Multi-scale representations deeply learned via convolutional neural netw...
research
03/05/2021

Variational Structured Attention Networks for Deep Visual Representation Learning

Convolutional neural networks have enabled major progress in addressing ...
research
01/01/2018

Learning Deep Structured Multi-Scale Features using Attention-Gated CRFs for Contour Prediction

Recent works have shown that exploiting multi-scale representations deep...
research
01/28/2016

Discriminative Training of Deep Fully-connected Continuous CRF with Task-specific Loss

Recent works on deep conditional random fields (CRF) have set new record...
research
04/30/2019

Structured Prediction using cGANs with Fusion Discriminator

We propose the fusion discriminator, a single unified framework for inco...

Please sign up or login with your details

Forgot password? Click here to reset