Novel Single View Constraints for Manhattan 3D Line Reconstruction

10/08/2018
by   Siddhant Ranade, et al.
6

This paper proposes a novel and exact method to reconstruct line-based 3D structure from a single image using Manhattan world assumption. This problem is a distinctly unsolved problem because there can be multiple 3D reconstructions from a single image. Thus, we are often forced to look for priors like Manhattan world assumption and common scene structures. In addition to the standard orthogonality, perspective projection, and parallelism constraints, we investigate a few novel constraints based on the physical realizability of the 3D scene structure. We treat the line segments in the image to be part of a graph similar to straws and connectors game, where the goal is to back-project the line segments in 3D space and while ensuring that some of these 3D line segments connect with each other (i.e., truly intersect in 3D space) to form the 3D structure. We consider three sets of novel constraints while solving the reconstruction: (1) constraints on a series of Manhattan line intersections that form cycles, but are not all physically realizable, (2) constraints on true and false intersections in the case of nearby lines lying on the same Manhattan plane, and (3) constraints from the intersections on boundary and non-boundary line segments. The reconstruction is achieved using mixed integer linear programming (MILP), and we show compelling results on real images. Along with this paper, we will release a challenging Single View Line Reconstruction dataset with ground truth 3D line models for research purposes.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 8

research
11/01/2019

Surface Reconstruction from 3D Line Segments

In man-made environments such as indoor scenes, when point-based 3D reco...
research
11/14/2020

On the Existence of Two View Chiral Reconstructions

A fundamental question in computer vision is whether a set of point pair...
research
03/23/2017

Robust SfM with Little Image Overlap

Usual Structure-from-Motion (SfM) techniques require at least trifocal o...
research
08/25/2022

Learning to Construct 3D Building Wireframes from 3D Line Clouds

Line clouds, though under-investigated in the previous work, potentially...
research
07/27/2021

PlaneTR: Structure-Guided Transformers for 3D Plane Recovery

This paper presents a neural network built upon Transformers, namely Pla...
research
08/15/2022

HoW-3D: Holistic 3D Wireframe Perception from a Single Image

This paper studies the problem of holistic 3D wireframe perception (HoW-...
research
03/24/2021

Beyond Visual Attractiveness: Physically Plausible Single Image HDR Reconstruction for Spherical Panoramas

HDR reconstruction is an important task in computer vision with many ind...

Please sign up or login with your details

Forgot password? Click here to reset