A Combinatorial Solution to Non-Rigid 3D Shape-to-Image Matching

11/16/2016
by   Florian Bernard, et al.
0

We propose a combinatorial solution for the problem of non-rigidly matching a 3D shape to 3D image data. To this end, we model the shape as a triangular mesh and allow each triangle of this mesh to be rigidly transformed to achieve a suitable matching to the image. By penalising the distance and the relative rotation between neighbouring triangles our matching compromises between image and shape information. In this paper, we resolve two major challenges: Firstly, we address the resulting large and NP-hard combinatorial problem with a suitable graph-theoretic approach. Secondly, we propose an efficient discretisation of the unbounded 6-dimensional Lie group SE(3). To our knowledge this is the first combinatorial formulation for non-rigid 3D shape-to-image matching. In contrast to existing local (gradient descent) optimisation methods, we obtain solutions that do not require a good initialisation and that are within a bound of the optimal solution. We evaluate the proposed method on the two problems of non-rigid 3D shape-to-shape and non-rigid 3D shape-to-image registration and demonstrate that it provides promising results.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
02/28/2020

MINA: Convex Mixed-Integer Programming for Non-Rigid Shape Alignment

We present a convex mixed-integer programming formulation for non-rigid ...
research
09/21/2008

Robust Near-Isometric Matching via Structured Learning of Graphical Models

Models for near-rigid shape matching are typically based on distance-rel...
research
10/06/2021

Learning Canonical Embedding for Non-rigid Shape Matching

This paper provides a novel framework that learns canonical embeddings f...
research
01/19/2016

Tetrisation of triangular meshes and its application in shape blending

The As-Rigid-As-Possible (ARAP) shape deformation framework is a versati...
research
11/21/2022

Conjugate Product Graphs for Globally Optimal 2D-3D Shape Matching

We consider the problem of finding a continuous and non-rigid matching b...
research
08/16/2023

SIGMA: Scale-Invariant Global Sparse Shape Matching

We propose a novel mixed-integer programming (MIP) formulation for gener...
research
09/12/2019

Optimized Synthesis of Snapping Fixtures

This paper deals with the following separability problem in 3D space: Gi...

Please sign up or login with your details

Forgot password? Click here to reset