Bridging the Domain Gap between Synthetic and Real-World Data for Autonomous Driving

06/05/2023
by   Xiangyu Bai, et al.
0

Modern autonomous systems require extensive testing to ensure reliability and build trust in ground vehicles. However, testing these systems in the real-world is challenging due to the lack of large and diverse datasets, especially in edge cases. Therefore, simulations are necessary for their development and evaluation. However, existing open-source simulators often exhibit a significant gap between synthetic and real-world domains, leading to deteriorated mobility performance and reduced platform reliability when using simulation data. To address this issue, our Scoping Autonomous Vehicle Simulation (SAVeS) platform benchmarks the performance of simulated environments for autonomous ground vehicle testing between synthetic and real-world domains. Our platform aims to quantify the domain gap and enable researchers to develop and test autonomous systems in a controlled environment. Additionally, we propose using domain adaptation technologies to address the domain gap between synthetic and real-world data with our SAVeS^+ extension. Our results demonstrate that SAVeS^+ is effective in helping to close the gap between synthetic and real-world domains and yields comparable performance for models trained with processed synthetic datasets to those trained on real-world datasets of same scale. This paper highlights our efforts to quantify and address the domain gap between synthetic and real-world data for autonomy simulation. By enabling researchers to develop and test autonomous systems in a controlled environment, we hope to bring autonomy simulation one step closer to realization.

READ FULL TEXT

page 5

page 10

research
02/08/2023

Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Driving

While developing perception based deep learning models, the benefit of s...
research
04/24/2023

Synthetic Datasets for Autonomous Driving: A Survey

Autonomous driving techniques have been flourishing in recent years whil...
research
07/25/2021

DR2L: Surfacing Corner Cases to Robustify Autonomous Driving via Domain Randomization Reinforcement Learning

How to explore corner cases as efficiently and thoroughly as possible ha...
research
11/15/2021

Towards Optimal Strategies for Training Self-Driving Perception Models in Simulation

Autonomous driving relies on a huge volume of real-world data to be labe...
research
04/14/2020

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

Visual recognition ecosystems (e.g. ImageNet, Pascal, COCO) have undenia...
research
08/01/2022

A performance contextualization approach to validating camera models for robot simulation

The focus of this contribution is on camera simulation as it comes into ...
research
08/05/2022

A Lightweight Machine Learning Pipeline for LiDAR-simulation

Virtual testing is a crucial task to ensure safety in autonomous driving...

Please sign up or login with your details

Forgot password? Click here to reset