Segmentation-guided Domain Adaptation for Efficient Depth Completion

10/14/2022
by   Fabian Märkert, et al.
0

Complete depth information and efficient estimators have become vital ingredients in scene understanding for automated driving tasks. A major problem for LiDAR-based depth completion is the inefficient utilization of convolutions due to the lack of coherent information as provided by the sparse nature of uncorrelated LiDAR point clouds, which often leads to complex and resource-demanding networks. The problem is reinforced by the expensive aquisition of depth data for supervised training. In this work, we propose an efficient depth completion model based on a vgg05-like CNN architecture and propose a semi-supervised domain adaptation approach to transfer knowledge from synthetic to real world data to improve data-efficiency and reduce the need for a large database. In order to boost spatial coherence, we guide the learning process using segmentations as additional source of information. The efficiency and accuracy of our approach is evaluated on the KITTI dataset. Our approach improves on previous efficient and low parameter state of the art approaches while having a noticeably lower computational footprint.

READ FULL TEXT

page 6

page 9

page 10

research
08/03/2020

Project to Adapt: Domain Adaptation for Depth Completion from Noisy and Sparse Sensor Data

Depth completion aims to predict a dense depth map from a sparse depth i...
research
08/02/2018

Sparse and Dense Data with CNNs: Depth Completion and Semantic Segmentation

Convolutional neural networks are designed for dense data, but vision da...
research
07/16/2020

Complete Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Clouds

We study an unsupervised domain adaptation problem for the semantic labe...
research
03/15/2020

Scene Completenesss-Aware Lidar Depth Completion for Driving Scenario

In this paper we propose Scene Completeness-Aware Depth Completion (SADC...
research
03/15/2020

Scene Completeness-Aware Lidar Depth Completion for Driving Scenario

In this paper we propose Scene Completeness-Aware Depth Completion (SADC...
research
09/30/2021

Unsupervised Domain Adaptation for LiDAR Panoptic Segmentation

Scene understanding is a pivotal task for autonomous vehicles to safely ...
research
03/21/2023

Lidar Line Selection with Spatially-Aware Shapley Value for Cost-Efficient Depth Completion

Lidar is a vital sensor for estimating the depth of a scene. Typical spi...

Please sign up or login with your details

Forgot password? Click here to reset