Semantic Motion Segmentation Using Dense CRF Formulation

04/24/2015
by   N Dinesh Reddy, et al.
0

While the literature has been fairly dense in the areas of scene understanding and semantic labeling there have been few works that make use of motion cues to embellish semantic performance and vice versa. In this paper, we address the problem of semantic motion segmentation, and show how semantic and motion priors augments performance. We pro- pose an algorithm that jointly infers the semantic class and motion labels of an object. Integrating semantic, geometric and optical ow based constraints into a dense CRF-model we infer both the object class as well as motion class, for each pixel. We found improvement in performance using a fully connected CRF as compared to a standard clique-based CRFs. For inference, we use a Mean Field approximation based algorithm. Our method outperforms recently pro- posed motion detection algorithms and also improves the semantic labeling compared to the state-of-the-art Automatic Labeling Environment algorithm on the challenging KITTI dataset especially for object classes such as pedestrians and cars that are critical to an outdoor robotic navigation scenario.

READ FULL TEXT

page 2

page 5

page 6

page 7

research
06/29/2014

Fusion Based Holistic Road Scene Understanding

This paper addresses the problem of holistic road scene understanding ba...
research
09/28/2017

Soft Correspondences in Multimodal Scene Parsing

Exploiting multiple modalities for semantic scene parsing has been shown...
research
10/20/2012

Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials

Most state-of-the-art techniques for multi-class image segmentation and ...
research
12/11/2019

Bipartite Conditional Random Fields for Panoptic Segmentation

We tackle the panoptic segmentation problem with a conditional random fi...
research
11/10/2015

Semantic Image Segmentation with Task-Specific Edge Detection Using CNNs and a Discriminatively Trained Domain Transform

Deep convolutional neural networks (CNNs) are the backbone of state-of-a...
research
10/05/2021

Fully Self-Supervised Class Awareness in Dense Object Descriptors

We address the problem of inferring self-supervised dense semantic corre...
research
10/20/2017

SEGCloud: Semantic Segmentation of 3D Point Clouds

3D semantic scene labeling is fundamental to agents operating in the rea...

Please sign up or login with your details

Forgot password? Click here to reset