GeoLayout: Geometry Driven Room Layout Estimation Based on Depth Maps of Planes

08/14/2020
by   Weidong Zhang, et al.
37

The task of room layout estimation is to locate the wall-floor, wall-ceiling, and wall-wall boundaries. Most recent methods solve this problem based on edge/keypoint detection or semantic segmentation. However, these approaches have shown limited attention on the geometry of the dominant planes and the intersection between them, which has significant impact on room layout. In this work, we propose to incorporate geometric reasoning to deep learning for layout estimation. Our approach learns to infer the depth maps of the dominant planes in the scene by predicting the pixel-level surface parameters, and the layout can be generated by the intersection of the depth maps. Moreover, we present a new dataset with pixel-level depth annotation of dominant planes. It is larger than the existing datasets and contains both cuboid and non-cuboid rooms. Experimental results show that our approach produces considerable performance gains on both 2D and 3D datasets.

READ FULL TEXT

page 10

page 12

page 13

research
01/12/2019

HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentation

We present a new approach to the problem of estimating 3D room layout fr...
research
04/01/2021

LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Rendering

Although significant progress has been made in room layout estimation, m...
research
10/09/2019

3D Manhattan Room Layout Reconstruction from a Single 360 Image

Recent approaches for predicting layouts from 360 panoramas produce exce...
research
05/20/2020

Classifying Suspicious Content in Tor Darknet

One of the tasks of law enforcement agencies is to find evidence of crim...
research
04/17/2023

U2RLE: Uncertainty-Guided 2-Stage Room Layout Estimation

While the existing deep learning-based room layout estimation techniques...
research
03/30/2020

LayoutMP3D: Layout Annotation of Matterport3D

Inferring the information of 3D layout from a single equirectangular pan...
research
01/08/2021

Geometry-Based Layout Generation with Hyper-Relations AMONG Objects

Recent studies show increasing demands and interests in automatically ge...

Please sign up or login with your details

Forgot password? Click here to reset