Compressing Sensor Data for Remote Assistance of Autonomous Vehicles using Deep Generative Models

11/05/2021
by   Daniel Bogdoll, et al.
35

In the foreseeable future, autonomous vehicles will require human assistance in situations they can not resolve on their own. In such scenarios, remote assistance from a human can provide the required input for the vehicle to continue its operation. Typical sensors used in autonomous vehicles include camera and lidar sensors. Due to the massive volume of sensor data that must be sent in real-time, highly efficient data compression is elementary to prevent an overload of network infrastructure. Sensor data compression using deep generative neural networks has been shown to outperform traditional compression approaches for both image and lidar data, regarding compression rate as well as reconstruction quality. However, there is a lack of research about the performance of generative-neural-network-based compression algorithms for remote assistance. In order to gain insights into the feasibility of deep generative models for usage in remote assistance, we evaluate state-of-the-art algorithms regarding their applicability and identify potential weaknesses. Further, we implement an online pipeline for processing sensor data and demonstrate its performance for remote assistance using the CARLA simulator.

READ FULL TEXT

page 6

page 7

page 14

page 15

page 16

research
01/16/2023

JKU-ITS Automobile for Research on Autonomous Vehicles

In this paper, we present our brand-new platform for Automated Driving r...
research
07/30/2019

Beyond Safety Drivers: Staffing a Teleoperations System for Autonomous Vehicles

Driverless vehicles promise a host of societal benefits including dramat...
research
05/11/2023

DeepSTEP – Deep Learning-Based Spatio-Temporal End-To-End Perception for Autonomous Vehicles

Autonomous vehicles demand high accuracy and robustness of perception al...
research
11/04/2022

Efficient Extrinsic Calibration of Multi-Sensor 3D LiDAR Systems for Autonomous Vehicles using Static Objects Information

For an autonomous vehicle, the ability to sense its surroundings and to ...
research
08/04/2023

Human-Centered Design and Evaluation of a Workplace for the Remote Assistance of Highly Automated Vehicles

Remotely operating vehicles utilizes the benefits of vehicle automation ...
research
07/20/2020

Memory-aware Online Compression of CAN Bus Data for Future Vehicular Systems

Vehicles generate a large amount of data from their internal sensors. Th...
research
05/08/2023

Accelerating Statewide Connected Vehicles Big (Sensor Fusion) Data ETL Pipelines on GPUs

Real-time traffic and sensor data from connected vehicles have the poten...

Please sign up or login with your details

Forgot password? Click here to reset