Augmented Informative Cooperative Perception

by   Pengyuan Zhou, et al.

Connected vehicles, whether equipped with advanced driver-assistance systems or fully autonomous, are currently constrained to visual information in their lines-of-sight. A cooperative perception system among vehicles increases their situational awareness by extending their perception ranges. Existing solutions imply significant network and computation load, as well as high flow of not-always-relevant data received by vehicles. To address such issues, and thus account for the inherently diverse informativeness of the data, we present Augmented Informative Cooperative Perception (AICP) as the first fast-filtering system which optimizes the informativeness of shared data at vehicles. AICP displays the filtered data to the drivers in augmented reality head-up display. To this end, an informativeness maximization problem is presented for vehicles to select a subset of data to display to their drivers. Specifically, we propose (i) a dedicated system design with custom data structure and light-weight routing protocol for convenient data encapsulation, fast interpretation and transmission, and (ii) a comprehensive problem formulation and efficient fitness-based sorting algorithm to select the most valuable data to display at the application layer. We implement a proof-of-concept prototype of AICP with a bandwidth-hungry, latency-constrained real-life augmented reality application. The prototype realizes the informative-optimized cooperative perception with only 12.6 milliseconds additional latency. Next, we test the networking performance of AICP at scale and show that AICP effectively filter out less relevant packets and decreases the channel busy time.



There are no comments yet.


page 1

page 8


DAARIA: Driver Assistance by Augmented Reality for Intelligent Automobile

Taking into account the drivers' state is a major challenge for designin...

A multi-plane augmented reality head-up display system based on volume holographic optical elements with large area

The traditional head-up display (HUD) system has the disadvantages of a ...

Design and Test of an adaptive augmented reality interface to manage systems to assist critical missions

We present a user interface (UI) based on augmented reality (AR) with he...

Augmented Reality-Based Advanced Driver-Assistance System for Connected Vehicles

With the development of advanced communication technology, connected veh...

Joint Sensing, Communication, and Computation Resource Allocation for Cooperative Perception in Fog-Based Vehicular Networks

To enlarge the perception range and reliability of individual autonomous...

5G MEC Computation Handoff for Mobile Augmented Reality

The combination of 5G and Multi-access Edge Computing (MEC) can signific...

Evaluating Transport Protocols on 5G for Mobile Augmented Reality

Mobile Augmented Reality (MAR) mixes physical environments with user-int...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.