Diffusion-Augmented Depth Prediction with Sparse Annotations

08/04/2023
by   Jiaqi Li, et al.
0

Depth estimation aims to predict dense depth maps. In autonomous driving scenes, sparsity of annotations makes the task challenging. Supervised models produce concave objects due to insufficient structural information. They overfit to valid pixels and fail to restore spatial structures. Self-supervised methods are proposed for the problem. Their robustness is limited by pose estimation, leading to erroneous results in natural scenes. In this paper, we propose a supervised framework termed Diffusion-Augmented Depth Prediction (DADP). We leverage the structural characteristics of diffusion model to enforce depth structures of depth models in a plug-and-play manner. An object-guided integrality loss is also proposed to further enhance regional structure integrality by fetching objective information. We evaluate DADP on three driving benchmarks and achieve significant improvements in depth structures and robustness. Our work provides a new perspective on depth estimation with sparse annotations in autonomous driving scenes.

READ FULL TEXT

page 3

page 5

page 7

page 8

page 11

page 12

page 13

page 14

research
04/12/2020

Toward Hierarchical Self-Supervised Monocular Absolute Depth Estimation for Autonomous Driving Applications

In recent years, self-supervised methods for monocular depth estimation ...
research
09/22/2021

Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-supervised Learning

Due to difficulties in acquiring ground truth depth of equirectangular (...
research
06/20/2023

BEVScope: Enhancing Self-Supervised Depth Estimation Leveraging Bird's-Eye-View in Dynamic Scenarios

Depth estimation is a cornerstone of perception in autonomous driving an...
research
04/06/2023

EGA-Depth: Efficient Guided Attention for Self-Supervised Multi-Camera Depth Estimation

The ubiquitous multi-camera setup on modern autonomous vehicles provides...
research
01/09/2023

Deep Planar Parallax for Monocular Depth Estimation

Depth estimation is a fundamental problem in the perception system of au...
research
04/24/2022

RealNet: Combining Optimized Object Detection with Information Fusion Depth Estimation Co-Design Method on IoT

Depth Estimation and Object Detection Recognition play an important role...
research
07/07/2021

Edge-aware Bidirectional Diffusion for Dense Depth Estimation from Light Fields

We present an algorithm to estimate fast and accurate depth maps from li...

Please sign up or login with your details

Forgot password? Click here to reset