DeepAI AI Chat
Log In Sign Up

Plants Don't Walk on the Street: Common-Sense Reasoning for Reliable Semantic Segmentation

by   Linara Adilova, et al.

Data-driven sensor interpretation in autonomous driving can lead to highly implausible predictions as can most of the time be verified with common-sense knowledge. However, learning common knowledge only from data is hard and approaches for knowledge integration are an active research area. We propose to use a partly human-designed, partly learned set of rules to describe relations between objects of a traffic scene on a high level of abstraction. In doing so, we improve and robustify existing deep neural networks consuming low-level sensor information. We present an initial study adapting the well-established Probabilistic Soft Logic (PSL) framework to validate and improve on the problem of semantic segmentation. We describe in detail how we integrate common knowledge into the segmentation pipeline using PSL and verify our approach in a set of experiments demonstrating the increase in robustness against several severe image distortions applied to the A2D2 autonomous driving data set.


page 1

page 5


DSNet for Real-Time Driving Scene Semantic Segmentation

We focus on the very challenging task of semantic segmentation for auton...

Street-Map Based Validation of Semantic Segmentation in Autonomous Driving

Artificial intelligence for autonomous driving must meet strict requirem...

Safety Metrics for Semantic Segmentation in Autonomous Driving

Within the context of autonomous driving, safety-related metrics for dee...

STDC-MA Network for Semantic Segmentation

Semantic segmentation is applied extensively in autonomous driving and i...

Self Supervised Occupancy Grid Learning from Sparse Radar for Autonomous Driving

Occupancy grid mapping is an important component of autonomous vehicle p...

Deep Inverse Sensor Models as Priors for evidential Occupancy Mapping

With the recent boost in autonomous driving, increased attention has bee...

Integrating Knowledge and Reasoning in Image Understanding

Deep learning based data-driven approaches have been successfully applie...