Robust Roadside Perception for Autonomous Driving: an Annotation-free Strategy with Synthesized Data

06/29/2023
by   Rusheng Zhang, et al.
0

Recently, with the rapid development in vehicle-to-infrastructure communication technologies, the infrastructure-based, roadside perception system for cooperative driving has become a rising field. This paper focuses on one of the most critical challenges - the data-insufficiency problem. The lacking of high-quality labeled roadside sensor data with high diversity leads to low robustness, and low transfer-ability of current roadside perception systems. In this paper, a novel approach is proposed to address this problem by creating synthesized training data using Augmented Reality and Generative Adversarial Network. This method creates synthesized dataset that is capable of training or fine-tuning a roadside perception detector which is robust to different weather and lighting conditions, or to adapt a new deployment location. We validate our approach at two intersections: Mcity intersection and State St/Ellsworth Rd roundabout. Our experiments show that (1) the detector can achieve good performance in all conditions when trained on synthesized data only, and (2) the performance of an existing detector trained with labeled data can be enhanced by synthesized data in harsh conditions.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
05/26/2023

Selective Communication for Cooperative Perception in End-to-End Autonomous Driving

The reliability of current autonomous driving systems is often jeopardiz...
research
07/18/2022

iDriving: Toward Safe and Efficient Infrastructure-directed Autonomous Driving

Autonomous driving will become pervasive in the coming decades. iDriving...
research
03/25/2021

StyleLess layer: Improving robustness for real-world driving

Deep Neural Networks (DNNs) are a critical component for self-driving ve...
research
01/13/2018

Autonomous Driving in Reality with Reinforcement Learning and Image Translation

Supervised learning is widely used in training autonomous driving vehicl...
research
10/15/2021

DG-Labeler and DGL-MOTS Dataset: Boost the Autonomous Driving Perception

Multi-object tracking and segmentation (MOTS) is a critical task for aut...
research
07/03/2018

Modular Vehicle Control for Transferring Semantic Information to Unseen Weather Conditions using GANs

End-to-end supervised learning has shown promising results for self-driv...
research
07/14/2023

Improving Zero-Shot Generalization for CLIP with Synthesized Prompts

With the growing interest in pretrained vision-language models like CLIP...

Please sign up or login with your details

Forgot password? Click here to reset