Self-Supervised Joint Learning Framework of Depth Estimation via Implicit Cues

06/17/2020
by   Jianrong Wang, et al.
16

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network. Compared with static views, abundant dynamic properties between video frames are beneficial to refined depth estimation, especially for dynamic objects. In this work, we propose a novel self-supervised joint learning framework for depth estimation using consecutive frames from monocular and stereo videos. The main idea is using an implicit depth cue extractor which leverages dynamic and static cues to generate useful depth proposals. These cues can predict distinguishable motion contours and geometric scene structures. Furthermore, a new high-dimensional attention module is introduced to extract clear global transformation, which effectively suppresses uncertainty of local descriptors in high-dimensional space, resulting in a more reliable optimization in learning framework. Experiments demonstrate that the proposed framework outperforms the state-of-the-art(SOTA) on KITTI and Make3D datasets.

READ FULL TEXT

page 5

page 6

page 7

research
05/10/2023

FusionDepth: Complement Self-Supervised Monocular Depth Estimation with Cost Volume

Multi-view stereo depth estimation based on cost volume usually works be...
research
03/09/2022

ChiTransformer:Towards Reliable Stereo from Cues

Current stereo matching techniques are challenged by restricted searchin...
research
08/14/2023

DS-Depth: Dynamic and Static Depth Estimation via a Fusion Cost Volume

Self-supervised monocular depth estimation methods typically rely on the...
research
02/18/2021

Improved Point Transformation Methods For Self-Supervised Depth Prediction

Given stereo or egomotion image pairs, a popular and successful method f...
research
05/20/2022

Self-Supervised Depth Estimation with Isometric-Self-Sample-Based Learning

Managing the dynamic regions in the photometric loss formulation has bee...
research
06/20/2023

Self-supervised Multi-task Learning Framework for Safety and Health-Oriented Connected Driving Environment Perception using Onboard Camera

Cutting-edge connected vehicle (CV) technologies have drawn much attenti...
research
06/28/2022

When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimation

Self-supervised deep learning methods for joint depth and ego-motion est...

Please sign up or login with your details

Forgot password? Click here to reset