Parsing Semantic Parts of Cars Using Graphical Models and Segment Appearance Consistency

06/09/2014
by   Wenhao Lu, et al.
0

This paper addresses the problem of semantic part parsing (segmentation) of cars, i.e.assigning every pixel within the car to one of the parts (e.g.body, window, lights, license plates and wheels). We formulate this as a landmark identification problem, where a set of landmarks specifies the boundaries of the parts. A novel mixture of graphical models is proposed, which dynamically couples the landmarks to a hierarchy of segments. When modeling pairwise relation between landmarks, this coupling enables our model to exploit the local image contents in addition to spatial deformation, an aspect that most existing graphical models ignore. In particular, our model enforces appearance consistency between segments within the same part. Parsing the car, including finding the optimal coupling between landmarks and segments in the hierarchy, is performed by dynamic programming. We evaluate our method on a subset of PASCAL VOC 2010 car images and on the car subset of 3D Object Category dataset (CAR3D). We show good results and, in particular, quantify the effectiveness of using the segment appearance consistency in terms of accuracy of part localization and segmentation.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 8

page 9

page 10

page 11

research
12/18/2014

Semantic Part Segmentation using Compositional Model combining Shape and Appearance

In this paper, we study the problem of semantic part segmentation for an...
research
01/29/2015

Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation

This paper presents a method for learning And-Or models to represent con...
research
05/20/2022

Action parsing using context features

We propose an action parsing algorithm to parse a video sequence contain...
research
12/14/2014

Combining the Best of Graphical Models and ConvNets for Semantic Segmentation

We present a two-module approach to semantic segmentation that incorpora...
research
11/27/2018

Part-level Car Parsing and Reconstruction from Single Street View

In this paper, we make the first attempt to build a framework to simulta...
research
08/10/2019

Towards Online Observability-Aware Trajectory Optimization for Landmark-based Estimators

As autonomous systems rely increasingly on onboard sensors for localizat...
research
07/11/2012

Recovering Articulated Object Models from 3D Range Data

We address the problem of unsupervised learning of complex articulated o...

Please sign up or login with your details

Forgot password? Click here to reset