A Simple Baseline for Supervised Surround-view Depth Estimation

03/14/2023
by   Xianda Guo, et al.
0

Depth estimation has been widely studied and serves as the fundamental step of 3D perception for autonomous driving. Though significant progress has been made for monocular depth estimation in the past decades, these attempts are mainly conducted on the KITTI benchmark with only front-view cameras, which ignores the correlations across surround-view cameras. In this paper, we propose S3Depth, a Simple Baseline for Supervised Surround-view Depth Estimation, to jointly predict the depth maps across multiple surrounding cameras. Specifically, we employ a global-to-local feature extraction module which combines CNN with transformer layers for enriched representations. Further, the Adjacent-view Attention mechanism is proposed to enable the intra-view and inter-view feature propagation. The former is achieved by the self-attention module within each view, while the latter is realized by the adjacent attention module, which computes the attention across multi-cameras to exchange the multi-scale representations across surround-view feature maps. Extensive experiments show that our method achieves superior performance over existing state-of-the-art methods on both DDAD and nuScenes datasets.

READ FULL TEXT
research
04/07/2022

SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation

Depth estimation from images serves as the fundamental step of 3D percep...
research
12/24/2021

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

Self-supervised learning has shown very promising results for monocular ...
research
04/06/2023

EGA-Depth: Efficient Guided Attention for Self-Supervised Multi-Camera Depth Estimation

The ubiquitous multi-camera setup on modern autonomous vehicles provides...
research
10/05/2022

Multi-Camera Collaborative Depth Prediction via Consistent Structure Estimation

Depth map estimation from images is an important task in robotic systems...
research
07/14/2021

MSFNet:Multi-scale features network for monocular depth estimation

In recent years, monocular depth estimation is applied to understand the...
research
09/01/2020

Bidirectional Attention Network for Monocular Depth Estimation

In this paper, we propose a Bidirectional Attention Network (BANet), an ...
research
04/13/2023

iDisc: Internal Discretization for Monocular Depth Estimation

Monocular depth estimation is fundamental for 3D scene understanding and...

Please sign up or login with your details

Forgot password? Click here to reset