Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges

01/16/2023
by   Yushan Han, et al.
0

Collaborative perception is essential to address occlusion and sensor failure issues in autonomous driving. In recent years, deep learning on collaborative perception has become even thriving, with numerous methods have been proposed. Although some works have reviewed and analyzed the basic architecture and key components in this field, there is still a lack of reviews on systematical collaboration modules in perception networks and large-scale collaborative perception datasets. The primary goal of this work is to address the abovementioned issues and provide a comprehensive review of recent achievements in this field. First, we introduce fundamental technologies and collaboration schemes. Following that, we provide an overview of practical collaborative perception methods and systematically summarize the collaboration modules in networks to improve collaboration efficiency and performance while also ensuring collaboration robustness and safety. Then, we present large-scale public datasets and summarize quantitative results on these benchmarks. Finally, we discuss the remaining challenges and promising future research directions.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 12

research
08/22/2022

Collaborative Perception for Autonomous Driving: Current Status and Future Trend

Perception is one of the crucial module of the autonomous driving system...
research
08/31/2023

Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perception

Vehicle-to-everything (V2X) autonomous driving opens up a promising dire...
research
07/18/2022

Latency-Aware Collaborative Perception

Collaborative perception has recently shown great potential to improve p...
research
03/16/2023

Among Us: Adversarially Robust Collaborative Perception by Consensus

Multiple robots could perceive a scene (e.g., detect objects) collaborat...
research
02/17/2022

V2X-Sim: A Virtual Collaborative Perception Dataset for Autonomous Driving

Vehicle-to-everything (V2X), which denotes the collaboration between a v...
research
07/04/2020

Sensor-Based Control for Collaborative Robots: Fundamentals, Challenges and Opportunities

The objective of this paper is to present a systematic review of existin...
research
03/22/2023

UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Framework

Multi-agent collaborative perception (MCP) has recently attracted much a...

Please sign up or login with your details

Forgot password? Click here to reset