Fusion Based Holistic Road Scene Understanding

06/29/2014
by   Wenqi Huang, et al.
0

This paper addresses the problem of holistic road scene understanding based on the integration of visual and range data. To achieve the grand goal, we propose an approach that jointly tackles object-level image segmentation and semantic region labeling within a conditional random field (CRF) framework. Specifically, we first generate semantic object hypotheses by clustering 3D points, learning their prior appearance models, and using a deep learning method for reasoning their semantic categories. The learned priors, together with spatial and geometric contexts, are incorporated in CRF. With this formulation, visual and range data are fused thoroughly, and moreover, the coupled segmentation and semantic labeling problem can be inferred via Graph Cuts. Our approach is validated on the challenging KITTI dataset that contains diverse complicated road scenarios. Both quantitative and qualitative evaluations demonstrate its effectiveness.

READ FULL TEXT

page 2

page 5

page 7

page 10

page 11

page 13

research
04/24/2015

Semantic Motion Segmentation Using Dense CRF Formulation

While the literature has been fairly dense in the areas of scene underst...
research
02/23/2015

Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding

Classifying single image patches is important in many different applicat...
research
06/16/2014

Human-Machine CRFs for Identifying Bottlenecks in Holistic Scene Understanding

Recent trends in image understanding have pushed for holistic scene unde...
research
06/03/2016

Reinforcement Learning for Semantic Segmentation in Indoor Scenes

Future advancements in robot autonomy and sophistication of robotics tas...
research
09/16/2013

Visual-Semantic Scene Understanding by Sharing Labels in a Context Network

We consider the problem of naming objects in complex, natural scenes con...
research
03/29/2020

ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings

We present ClusterVO, a stereo Visual Odometry which simultaneously clus...
research
12/14/2018

A Parametric Top-View Representation of Complex Road Scenes

In this paper, we address the problem of inferring the layout of complex...

Please sign up or login with your details

Forgot password? Click here to reset