Structured Coupled Generative Adversarial Networks for Unsupervised Monocular Depth Estimation

08/15/2019
by   Mihai Marian Puscas, et al.
4

Inspired by the success of adversarial learning, we propose a new end-to-end unsupervised deep learning framework for monocular depth estimation consisting of two Generative Adversarial Networks (GAN), deeply coupled with a structured Conditional Random Field (CRF) model. The two GANs aim at generating distinct and complementary disparity maps and at improving the generation quality via exploiting the adversarial learning strategy. The deep CRF coupling model is proposed to fuse the generative and discriminative outputs from the dual GAN nets. As such, the model implicitly constructs mutual constraints on the two network branches and between the generator and discriminator. This facilitates the optimization of the whole network for better disparity generation. Extensive experiments on the KITTI, Cityscapes, and Make3D datasets clearly demonstrate the effectiveness of the proposed approach and show superior performance compared to state of the art methods. The code and models are available at https://github.com/mihaipuscas/ 3dv---coupled-crf-disparity.

READ FULL TEXT

page 3

page 5

page 6

page 7

page 8

research
07/28/2018

Unsupervised Adversarial Depth Estimation using Cycled Generative Networks

While recent deep monocular depth estimation approaches based on supervi...
research
04/30/2019

Structured Prediction using cGANs with Fusion Discriminator

We propose the fusion discriminator, a single unified framework for inco...
research
08/22/2018

Rethinking Monocular Depth Estimation with Adversarial Training

Monocular depth estimation is an extensively studied computer vision pro...
research
06/20/2019

SGANVO: Unsupervised Deep Visual Odometry and Depth Estimation with Stacked Generative Adversarial Networks

Recently end-to-end unsupervised deep learning methods have achieved an ...
research
07/14/2020

Spectrum-Guided Adversarial Disparity Learning

It has been a significant challenge to portray intraclass disparity prec...
research
05/28/2023

OccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation

Light field (LF) depth estimation is a crucial task with numerous practi...
research
07/19/2020

Symbiotic Adversarial Learning for Attribute-based Person Search

Attribute-based person search is in significant demand for applications ...

Please sign up or login with your details

Forgot password? Click here to reset