Rethinking Monocular Depth Estimation with Adversarial Training

08/22/2018
by   Richard Chen, et al.
10

Monocular depth estimation is an extensively studied computer vision problem with a vast variety of applications. This work introduces a novel paradigm for monocular depth estimation using deep networks that incorporates adversarial loss. We describe a variety of deep learning architectures that include a structured loss term with conditional generative adversarial networks. In this framework, the generator learns a mapping between an RGB image and its corresponding depth map, while the discriminator learns to distinguish estimated depth maps from ground truth. We benchmark this approach on the NYUv2 and Make3D datasets, and observe that the addition of adversarial training reduces relative error significantly, achieving SOTA performance on Make3D. These results suggest that adversarial training is a powerful technique for improving depth estimation performance of deep networks.

READ FULL TEXT

page 2

page 3

research
09/23/2021

Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Data

Depth estimation from a single image is an active research topic in comp...
research
08/11/2021

Towards Interpretable Deep Networks for Monocular Depth Estimation

Deep networks for Monocular Depth Estimation (MDE) have achieved promisi...
research
07/09/2021

Self-Supervised Generative Adversarial Network for Depth Estimation in Laparoscopic Images

Dense depth estimation and 3D reconstruction of a surgical scene are cru...
research
05/28/2020

Monocular Depth Estimators: Vulnerabilities and Attacks

Recent advancements of neural networks lead to reliable monocular depth ...
research
08/15/2019

Structured Coupled Generative Adversarial Networks for Unsupervised Monocular Depth Estimation

Inspired by the success of adversarial learning, we propose a new end-to...
research
05/30/2018

Learning to Generate Facial Depth Maps

In this paper, an adversarial architecture for facial depth map estimati...
research
12/01/2021

A benchmark with decomposed distribution shifts for 360 monocular depth estimation

In this work we contribute a distribution shift benchmark for a computer...

Please sign up or login with your details

Forgot password? Click here to reset