Transferable End-to-end Room Layout Estimation via Implicit Encoding

12/21/2021
by   Hao Zhao, et al.
2

We study the problem of estimating room layouts from a single panorama image. Most former works have two stages: feature extraction and parametric model fitting. Here we propose an end-to-end method that directly predicts parametric layouts from an input panorama image. It exploits an implicit encoding procedure that embeds parametric layouts into a latent space. Then learning a mapping from images to this latent space makes end-to-end room layout estimation possible. However end-to-end methods have several notorious drawbacks despite many intriguing properties. A widely raised criticism is that they are troubled with dataset bias and do not transfer to unfamiliar domains. Our study echos this common belief. To this end, we propose to use semantic boundary prediction maps as an intermediate domain. It brings significant performance boost on four benchmarks (Structured3D, PanoContext, S3DIS, and Matterport3D), notably in the zero-shot transfer setting. Code, data, and models will be released.

READ FULL TEXT

page 3

page 5

page 11

page 12

page 13

research
03/18/2017

RoomNet: End-to-End Room Layout Estimation

This paper focuses on the task of room layout estimation from a monocula...
research
02/07/2021

Single-Shot Cuboids: Geodesics-based End-to-end Manhattan Aligned Layout Estimation from Spherical Panoramas

It has been shown that global scene understanding tasks like layout esti...
research
04/11/2022

Structured Graph Variational Autoencoders for Indoor Furniture layout Generation

We present a structured graph variational autoencoder for generating the...
research
07/03/2017

Physics Inspired Optimization on Semantic Transfer Features: An Alternative Method for Room Layout Estimation

In this paper, we propose an alternative method to estimate room layouts...
research
05/12/2023

Visual Information Extraction in the Wild: Practical Dataset and End-to-end Solution

Visual information extraction (VIE), which aims to simultaneously perfor...
research
06/07/2019

Conditional Neural Style Transfer with Peer-Regularized Feature Transform

This paper introduces a neural style transfer model to conditionally gen...
research
03/19/2019

Corners for Layout: End-to-End Layout Recovery from 360 Images

The problem of 3D layout recovery in indoor scenes has been a core resea...

Please sign up or login with your details

Forgot password? Click here to reset