An Image-based Approach of Task-driven Driving Scene Categorization

03/10/2021
by   Shaochi Hu, et al.
6

Categorizing driving scenes via visual perception is a key technology for safe driving and the downstream tasks of autonomous vehicles. Traditional methods infer scene category by detecting scene-related objects or using a classifier that is trained on large datasets of fine-labeled scene images. Whereas at cluttered dynamic scenes such as campus or park, human activities are not strongly confined by rules, and the functional attributes of places are not strongly correlated with objects. So how to define, model and infer scene categories is crucial to make the technique really helpful in assisting a robot to pass through the scene. This paper proposes a method of task-driven driving scene categorization using weakly supervised data. Given a front-view video of a driving scene, a set of anchor points is marked by following the decision making of a human driver, where an anchor point is not a semantic label but an indicator meaning the semantic attribute of the scene is different from that of the previous one. A measure is learned to discriminate the scenes of different semantic attributes via contrastive learning, and a driving scene profiling and categorization method is developed based on that measure. Experiments are conducted on a front-view video that is recorded when a vehicle passed through the cluttered dynamic campus of Peking University. The scenes are categorized into straight road, turn road and alerting traffic. The results of semantic scene similarity learning and driving scene categorization are extensively studied, and positive result of scene categorization is 97.17 % on the learning video and 85.44% on the video of new scenes.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
03/05/2021

Fine-Grained Off-Road Semantic Segmentation and Mapping via Contrastive Learning

Road detection or traversability analysis has been a key technique for a...
research
11/19/2014

Affordances Provide a Fundamental Categorization Principle for Visual Scenes

How do we know that a kitchen is a kitchen by looking? Relatively little...
research
11/27/2019

Weakly-Supervised Road Affordances Inference and Learning in Scenes without Traffic Signs

Road attributes understanding is extensively researched to support vehic...
research
01/02/2023

Learning Road Scene-level Representations via Semantic Region Prediction

In this work, we tackle two vital tasks in automated driving systems, i....
research
05/29/2019

Dynamic Traffic Scene Classification with Space-Time Coherence

This paper examines the problem of dynamic traffic scene classification ...
research
11/08/2022

Dynamic loss balancing and sequential enhancement for road-safety assessment and traffic scene classification

Road-safety inspection is an indispensable instrument for reducing road-...
research
02/18/2022

An Active and Contrastive Learning Framework for Fine-Grained Off-Road Semantic Segmentation

Off-road semantic segmentation with fine-grained labels is necessary for...

Please sign up or login with your details

Forgot password? Click here to reset