Augmented Informative Cooperative Perception

01/14/2021
by   Pengyuan Zhou, et al.
0

Connected vehicles, whether equipped with advanced driver-assistance systems or fully autonomous, are currently constrained to visual information in their lines-of-sight. A cooperative perception system among vehicles increases their situational awareness by extending their perception ranges. Existing solutions imply significant network and computation load, as well as high flow of not-always-relevant data received by vehicles. To address such issues, and thus account for the inherently diverse informativeness of the data, we present Augmented Informative Cooperative Perception (AICP) as the first fast-filtering system which optimizes the informativeness of shared data at vehicles. AICP displays the filtered data to the drivers in augmented reality head-up display. To this end, an informativeness maximization problem is presented for vehicles to select a subset of data to display to their drivers. Specifically, we propose (i) a dedicated system design with custom data structure and light-weight routing protocol for convenient data encapsulation, fast interpretation and transmission, and (ii) a comprehensive problem formulation and efficient fitness-based sorting algorithm to select the most valuable data to display at the application layer. We implement a proof-of-concept prototype of AICP with a bandwidth-hungry, latency-constrained real-life augmented reality application. The prototype realizes the informative-optimized cooperative perception with only 12.6 milliseconds additional latency. Next, we test the networking performance of AICP at scale and show that AICP effectively filter out less relevant packets and decreases the channel busy time.

READ FULL TEXT

page 1

page 8

research
09/27/2012

DAARIA: Driver Assistance by Augmented Reality for Intelligent Automobile

Taking into account the drivers' state is a major challenge for designin...
research
03/25/2021

Design and Test of an adaptive augmented reality interface to manage systems to assist critical missions

We present a user interface (UI) based on augmented reality (AR) with he...
research
06/06/2022

Effects of Augmented-Reality-Based Assisting Interfaces on Drivers' Object-wise Situational Awareness in Highly Autonomous Vehicles

Although partially autonomous driving (AD) systems are already available...
research
08/31/2020

Augmented Reality-Based Advanced Driver-Assistance System for Connected Vehicles

With the development of advanced communication technology, connected veh...
research
12/12/2021

Joint Sensing, Communication, and Computation Resource Allocation for Cooperative Perception in Fog-Based Vehicular Networks

To enlarge the perception range and reliability of individual autonomous...
research
02/02/2023

Cooperative Saliency-based Obstacle Detection and AR Rendering for Increased Situational Awareness

Autonomous vehicles are expected to operate safely in real-life road con...
research
11/15/2022

zk-PoT: Zero-Knowledge Proof of Traffic for Privacy Enabled Cooperative Perception

Cooperative perception is an essential and widely discussed application ...

Please sign up or login with your details

Forgot password? Click here to reset