Human-Vehicle Cooperative Visual Perception for Shared Autonomous Driving

12/17/2021
by   Yiyue Zhao, et al.
0

With the development of key technologies like environment perception, the automation level of autonomous vehicles has been increasing. However, before reaching highly autonomous driving, manual driving still needs to participate in the driving process to ensure the safety of human-vehicle shared driving. The existing human-vehicle cooperative driving focuses on auto engineering and drivers' behaviors, with few research studies in the field of visual perception. Due to the bad performance in the complex road traffic conflict scenarios, cooperative visual perception needs to be studied further. In addition, the autonomous driving perception system cannot correctly understand the characteristics of manual driving. Based on the background above, this paper directly proposes a human-vehicle cooperative visual perception method to enhance the visual perception ability of shared autonomous driving based on the transfer learning method and the image fusion algorithm for the complex road traffic scenarios. Based on transfer learning, the mAP of object detection reaches 75.52 experiment further reveals that human-vehicle cooperative visual perception reflects the riskiest zone and predicts the conflict object's trajectory more precisely. This study pioneers a cooperative visual perception solution for shared autonomous driving and experiments in real-world complex traffic conflict scenarios, which can better support the following planning and controlling and improve the safety of autonomous vehicles.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

page 10

research
08/30/2022

Intelligent Perception System for Vehicle-Road Cooperation

With the development of autonomous driving, the improvement of autonomou...
research
10/31/2022

Design, Field Evaluation, and Traffic Analysis of a Competitive Autonomous Driving Model in a Congested Environment

Recently, numerous studies have investigated cooperative traffic systems...
research
12/16/2022

Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communication

Deep learning has been widely used in the perception (e.g., 3D object de...
research
05/26/2022

Efficient textual explanations for complex road and traffic scenarios based on semantic segmentation

The complex driving environment brings great challenges to the visual pe...
research
05/17/2021

Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception

Autonomous vehicles interacting with other traffic participants heavily ...
research
11/21/2022

CoPEM: Cooperative Perception Error Models for Autonomous Driving

In this paper, we introduce the notion of Cooperative Perception Error M...
research
10/14/2022

Motion Inspired Unsupervised Perception and Prediction in Autonomous Driving

Learning-based perception and prediction modules in modern autonomous dr...

Please sign up or login with your details

Forgot password? Click here to reset