Automated Augmentation with Reinforcement Learning and GANs for Robust Identification of Traffic Signs using Front Camera Images

11/15/2019
by   Sohini Roy Chowdhury, et al.
36

Traffic sign identification using camera images from vehicles plays a critical role in autonomous driving and path planning. However, the front camera images can be distorted due to blurriness, lighting variations and vandalism which can lead to degradation of detection performances. As a solution, machine learning models must be trained with data from multiple domains, and collecting and labeling more data in each new domain is time consuming and expensive. In this work, we present an end-to-end framework to augment traffic sign training data using optimal reinforcement learning policies and a variety of Generative Adversarial Network (GAN) models, that can then be used to train traffic sign detector modules. Our automated augmenter enables learning from transformed nightime, poor lighting, and varying degrees of occlusions using the LISA Traffic Sign and BDD-Nexar dataset. The proposed method enables mapping training data from one domain to another, thereby improving traffic sign detection precision/recall from 0.70/0.66 to 0.83/0.71 for nighttime images.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
01/13/2021

Road images augmentation with synthetic traffic signs using neural networks

Traffic sign recognition is a well-researched problem in computer vision...
research
12/16/2022

Traffic sign detection and recognition using event camera image reconstruction

This paper presents a method for detection and recognition of traffic si...
research
09/10/2019

Traffic Sign Detection and Classification around the World

Traffic signs are essential map features globally in the era of autonomo...
research
12/02/2021

On Salience-Sensitive Sign Classification in Autonomous Vehicle Path Planning: Experimental Explorations with a Novel Dataset

Safe path planning in autonomous driving is a complex task due to the in...
research
07/23/2019

Effortless Deep Training for Traffic Sign Detection Using Templates and Arbitrary Natural Images

Deep learning has been successfully applied to several problems related ...
research
09/05/2018

Conditional Transfer with Dense Residual Attention: Synthesizing traffic signs from street-view imagery

Object detection and classification of traffic signs in street-view imag...
research
10/24/2022

Boosting Kidney Stone Identification in Endoscopic Images Using Two-Step Transfer Learning

Knowing the cause of kidney stone formation is crucial to establish trea...

Please sign up or login with your details

Forgot password? Click here to reset