End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans

06/10/2019
by   Armen Avetisyan, et al.
3

We present a novel, end-to-end approach to align CAD models to an 3D scan of a scene, enabling transformation of a noisy, incomplete 3D scan to a compact, CAD reconstruction with clean, complete object geometry. Our main contribution lies in formulating a differentiable Procrustes alignment that is paired with a symmetry-aware dense object correspondence prediction. To simultaneously align CAD models to all the objects of a scanned scene, our approach detects object locations, then predicts symmetry-aware dense object correspondences between scan and CAD geometry in a unified object space, as well as a nearest neighbor CAD model, both of which are then used to inform a differentiable Procrustes alignment. Our approach operates in a fully-convolutional fashion, enabling alignment of CAD models to the objects of a scan in a single forward pass. This enables our method to outperform state-of-the-art approaches by 19.04% for CAD model alignment to scans, with ≈ 250× faster runtime than previous data-driven approaches.

READ FULL TEXT

page 1

page 4

page 7

page 8

page 11

page 12

research
11/27/2018

Scan2CAD: Learning CAD Model Alignment in RGB-D Scans

We present Scan2CAD, a novel data-driven method that learns to align cle...
research
03/24/2022

Weakly-Supervised End-to-End CAD Retrieval to Scan Objects

CAD model retrieval to real-world scene observations has shown strong pr...
research
03/27/2020

SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans

We present a novel approach to reconstructing lightweight, CAD-based rep...
research
05/08/2017

CAD Priors for Accurate and Flexible Instance Reconstruction

We present an efficient and automatic approach for accurate reconstructi...
research
12/08/2016

Exploiting 2D Floorplan for Building-scale Panorama RGBD Alignment

This paper presents a novel algorithm that utilizes a 2D floorplan to al...
research
06/30/2021

Recurrently Estimating Reflective Symmetry Planes from Partial Pointclouds

Many man-made objects are characterised by a shape that is symmetric alo...
research
08/12/2017

Calipso: Physics-based Image and Video Editing through CAD Model Proxies

We present Calipso, an interactive method for editing images and videos ...

Please sign up or login with your details

Forgot password? Click here to reset