The Edge of Depth: Explicit Constraints between Segmentation and Depth

04/01/2020
by   Shengjie Zhu, et al.
7

In this work we study the mutual benefits of two common computer vision tasks, self-supervised depth estimation and semantic segmentation from images. For example, to help unsupervised monocular depth estimation, constraints from semantic segmentation has been explored implicitly such as sharing and transforming features. In contrast, we propose to explicitly measure the border consistency between segmentation and depth and minimize it in a greedy manner by iteratively supervising the network towards a locally optimal solution. Partially this is motivated by our observation that semantic segmentation even trained with limited ground truth (200 images of KITTI) can offer more accurate border than that of any (monocular or stereo) image-based depth estimation. Through extensive experiments, our proposed approach advances the state of the art on unsupervised monocular depth estimation in the KITTI.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 13

page 14

page 15

research
10/18/2021

Self-Supervised Monocular Depth Estimation with Internal Feature Fusion

Self-supervised learning for depth estimation uses geometry in image seq...
research
10/09/2018

Geometry meets semantics for semi-supervised monocular depth estimation

Depth estimation from a single image represents a very exciting challeng...
research
10/23/2019

Deep Classification Network for Monocular Depth Estimation

Monocular Depth Estimation is usually treated as a supervised and regres...
research
03/31/2023

SemHint-MD: Learning from Noisy Semantic Labels for Self-Supervised Monocular Depth Estimation

Without ground truth supervision, self-supervised depth estimation can b...
research
10/06/2016

Exploiting Depth from Single Monocular Images for Object Detection and Semantic Segmentation

Augmenting RGB data with measured depth has been shown to improve the pe...
research
01/19/2021

SOSD-Net: Joint Semantic Object Segmentation and Depth Estimation from Monocular images

Depth estimation and semantic segmentation play essential roles in scene...
research
01/20/2023

FG-Depth: Flow-Guided Unsupervised Monocular Depth Estimation

The great potential of unsupervised monocular depth estimation has been ...

Please sign up or login with your details

Forgot password? Click here to reset