HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentation

01/12/2019
by   Cheng Sun, et al.
9

We present a new approach to the problem of estimating 3D room layout from a single panoramic image. We represent room layout as three 1D vectors that encode, at each image column, the boundary positions of floor-wall and ceiling-wall, and the existence of wall-wall boundary. The proposed network architecture, HorizonNet, trained for predicting 1D layout, outperforms previous state-of-the-art approaches. The designed post-processing procedure for recovering 3D room layouts from 1D predictions can automatically infer the room shape with low computation cost---it takes less than 20ms for a panorama image while prior works might need dozens of seconds. We also propose Pano Stretch Data Augmentation, which can diversify panorama data and be applied to other panorama-related learning tasks. Due to the limited training data available for non-cuboid layout, we re-annotate 65 general layout data from the current dataset for fine-tuning and qualitatively show the ability of our approach to estimate general layouts.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

research
09/07/2020

3D Room Layout Estimation Beyond the Manhattan World Assumption

Predicting 3D room layout from single image is a challenging task with m...
research
04/17/2023

U2RLE: Uncertainty-Guided 2-Stage Room Layout Estimation

While the existing deep learning-based room layout estimation techniques...
research
08/14/2020

GeoLayout: Geometry Driven Room Layout Estimation Based on Depth Maps of Planes

The task of room layout estimation is to locate the wall-floor, wall-cei...
research
10/01/2021

RoomStructNet: Learning to Rank Non-Cuboidal Room Layouts From Single View

In this paper, we present a new approach to estimate the layout of a roo...
research
10/09/2019

3D Manhattan Room Layout Reconstruction from a Single 360 Image

Recent approaches for predicting layouts from 360 panoramas produce exce...
research
01/26/2019

Hotels-50K: A Global Hotel Recognition Dataset

Recognizing a hotel from an image of a hotel room is important for human...
research
08/07/2021

On the optimal layout of a dining room in the era of COVID-19 using mathematical optimization

We consider the problem of maximizing the number of people that a dining...

Please sign up or login with your details

Forgot password? Click here to reset