Sensor Fusion of Camera and Cloud Digital Twin Information for Intelligent Vehicles

07/08/2020
by   Yongkang Liu, et al.
4

With the rapid development of intelligent vehicles and Advanced Driving Assistance Systems (ADAS), a mixed level of human driver engagements is involved in the transportation system. Visual guidance for drivers is essential under this situation to prevent potential risks. To advance the development of visual guidance systems, we introduce a novel sensor fusion methodology, integrating camera image and Digital Twin knowledge from the cloud. Target vehicle bounding box is drawn and matched by combining results of object detector running on ego vehicle and position information from the cloud. The best matching result, with a 79.2 (IoU) threshold, is obtained with depth image served as an additional feature source. Game engine-based simulation results also reveal that the visual guidance system could improve driving safety significantly cooperate with the cloud Digital Twin system.

READ FULL TEXT

Authors

page 2

page 5

12/07/2021

Vision-Cloud Data Fusion for ADAS: A Lane Change Prediction Case Study

With the rapid development of intelligent vehicles and Advanced Driver-A...
01/26/2021

Cloud-based traffic data fusion for situation evaluation of handover scenarios

Upcoming vehicles introduce functions at the level of conditional automa...
08/31/2020

Augmented Reality-Based Advanced Driver-Assistance System for Connected Vehicles

With the development of advanced communication technology, connected veh...
06/16/2019

Providentia -- A Large Scale Sensing System for the Assistance of Autonomous Vehicles

The environmental perception of autonomous vehicles is not only limited ...
10/07/2020

Modeling and analysis of driver behavior under shared control through weighted visual and haptic guidance

For the optimum design of a driver-automation shared control system, an ...
04/15/2021

Advanced Lane Detection Model for the Virtual Development of Highly Automated Functions

Virtual development and prototyping has already become an integral part ...
05/04/2021

Digital Twin-Assisted Cooperative Driving at Non-Signalized Intersections

Digital Twin, as an emerging technology related to Cyber-Physical System...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.