MeshDepth: Disconnected Mesh-based Deep Depth Prediction

05/03/2019
by   Masaya Kaneko, et al.
8

We propose a novel method for mesh-based single-view depth estimation using Convolutional Neural Networks (CNNs). Conventional CNN-based methods are only suitable for representing simple 3D objects because they estimate the deformation from a predefined simple mesh such as a cube or sphere. As a 3D scene representation, we introduce a disconnected mesh made of 2D mesh adaptively determined on the input image. We made a CNN-based framework to compute depths and normals of faces of the mesh. Because of the representation, our method can handle complex indoor scenes. Using common RGBD datasets, we show that our model achieved best or comparable performance comparing to the state-of-the-art pixel-wise dense methods. It should be noted that our method significantly reduces the number of the parameter representing the 3D structure.

READ FULL TEXT

page 1

page 4

page 6

page 8

research
04/06/2019

Visualization of Convolutional Neural Networks for Monocular Depth Estimation

Recently, convolutional neural networks (CNNs) have shown great success ...
research
05/17/2018

Recurrent Neural Network for Learning DenseDepth and Ego-Motion from Video

Learning-based, single-view depth estimation often generalizes poorly to...
research
11/03/2022

Revisiting and Optimising a CNN Colour Constancy Method for Multi-Illuminant Estimation

The aim of colour constancy is to discount the effect of the scene illum...
research
06/10/2020

3D Human Mesh Regression with Dense Correspondence

Estimating 3D mesh of the human body from a single 2D image is an import...
research
01/28/2020

Segmentation and Recovery of Superquadric Models using Convolutional Neural Networks

In this paper we address the problem of representing 3D visual data with...
research
07/24/2019

SDNet: Semantically Guided Depth Estimation Network

Autonomous vehicles and robots require a full scene understanding of the...
research
12/11/2019

DeepMeshFlow: Content Adaptive Mesh Deformation for Robust Image Registration

Image alignment by mesh warps, such as meshflow, is a fundamental task w...

Please sign up or login with your details

Forgot password? Click here to reset