3D Model Assisted Image Segmentation

02/09/2012
by   Srimal Jayawardena, et al.
0

The problem of segmenting a given image into coherent regions is important in Computer Vision and many industrial applications require segmenting a known object into its components. Examples include identifying individual parts of a component for process control work in a manufacturing plant and identifying parts of a car from a photo for automatic damage detection. Unfortunately most of an object's parts of interest in such applications share the same pixel characteristics, having similar colour and texture. This makes segmenting the object into its components a non-trivial task for conventional image segmentation algorithms. In this paper, we propose a "Model Assisted Segmentation" method to tackle this problem. A 3D model of the object is registered over the given image by optimising a novel gradient based loss function. This registration obtains the full 3D pose from an image of the object. The image can have an arbitrary view of the object and is not limited to a particular set of views. The segmentation is subsequently performed using a level-set based method, using the projected contours of the registered 3D model as initialisation curves. The method is fully automatic and requires no user interaction. Also, the system does not require any prior training. We present our results on photographs of a real car.

READ FULL TEXT

page 2

page 6

page 7

page 8

page 12

page 13

page 14

page 15

research
11/28/2013

A Novel Illumination-Invariant Loss for Monocular 3D Pose Estimation

The problem of identifying the 3D pose of a known object from a given 2D...
research
11/03/2010

Featureless 2D-3D Pose Estimation by Minimising an Illumination-Invariant Loss

The problem of identifying the 3D pose of a known object from a given 2D...
research
03/08/2016

A regularization-based approach for unsupervised image segmentation

We propose a novel unsupervised image segmentation algorithm, which aims...
research
04/28/2015

Identifying Reliable Annotations for Large Scale Image Segmentation

Challenging computer vision tasks, in particular semantic image segmenta...
research
09/07/2015

Convexity Shape Constraints for Image Segmentation

Segmenting an image into multiple components is a central task in comput...
research
02/02/2022

Automotive Parts Assessment: Applying Real-time Instance-Segmentation Models to Identify Vehicle Parts

The problem of automated car damage assessment presents a major challeng...
research
12/08/2016

3D Shape Segmentation with Projective Convolutional Networks

This paper introduces a deep architecture for segmenting 3D objects into...

Please sign up or login with your details

Forgot password? Click here to reset