DeepAI AI Chat
Log In Sign Up

Parsing Semantic Parts of Cars Using Graphical Models and Segment Appearance Consistency

by   Wenhao Lu, et al.

This paper addresses the problem of semantic part parsing (segmentation) of cars, i.e.assigning every pixel within the car to one of the parts (e.g.body, window, lights, license plates and wheels). We formulate this as a landmark identification problem, where a set of landmarks specifies the boundaries of the parts. A novel mixture of graphical models is proposed, which dynamically couples the landmarks to a hierarchy of segments. When modeling pairwise relation between landmarks, this coupling enables our model to exploit the local image contents in addition to spatial deformation, an aspect that most existing graphical models ignore. In particular, our model enforces appearance consistency between segments within the same part. Parsing the car, including finding the optimal coupling between landmarks and segments in the hierarchy, is performed by dynamic programming. We evaluate our method on a subset of PASCAL VOC 2010 car images and on the car subset of 3D Object Category dataset (CAR3D). We show good results and, in particular, quantify the effectiveness of using the segment appearance consistency in terms of accuracy of part localization and segmentation.


page 1

page 2

page 4

page 5

page 8

page 9

page 10

page 11


Semantic Part Segmentation using Compositional Model combining Shape and Appearance

In this paper, we study the problem of semantic part segmentation for an...

Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation

This paper presents a method for learning And-Or models to represent con...

Action parsing using context features

We propose an action parsing algorithm to parse a video sequence contain...

Combining the Best of Graphical Models and ConvNets for Semantic Segmentation

We present a two-module approach to semantic segmentation that incorpora...

Part-level Car Parsing and Reconstruction from Single Street View

In this paper, we make the first attempt to build a framework to simulta...

Towards Online Observability-Aware Trajectory Optimization for Landmark-based Estimators

As autonomous systems rely increasingly on onboard sensors for localizat...

Recovering Articulated Object Models from 3D Range Data

We address the problem of unsupervised learning of complex articulated o...