One Training for Multiple Deployments: Polar-based Adaptive BEV Perception for Autonomous Driving

04/02/2023
by   Huitong Yang, et al.
0

Current on-board chips usually have different computing power, which means multiple training processes are needed for adapting the same learning-based algorithm to different chips, costing huge computing resources. The situation becomes even worse for 3D perception methods with large models. Previous vision-centric 3D perception approaches are trained with regular grid-represented feature maps of fixed resolutions, which is not applicable to adapt to other grid scales, limiting wider deployment. In this paper, we leverage the Polar representation when constructing the BEV feature map from images in order to achieve the goal of training once for multiple deployments. Specifically, the feature along rays in Polar space can be easily adaptively sampled and projected to the feature in Cartesian space with arbitrary resolutions. To further improve the adaptation capability, we make multi-scale contextual information interact with each other to enhance the feature representation. Experiments on a large-scale autonomous driving dataset show that our method outperforms others as for the good property of one training for multiple deployments.

READ FULL TEXT

page 1

page 5

research
03/02/2023

Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review

Grid-centric perception is a crucial field for mobile robot perception a...
research
12/17/2022

Are We Ready for Vision-Centric Driving Streaming Perception? The ASAP Benchmark

In recent years, vision-centric perception has flourished in various aut...
research
08/08/2023

PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection

Recently, polar-based representation has shown promising properties in p...
research
08/17/2023

Sensor Fusion by Spatial Encoding for Autonomous Driving

Sensor fusion is critical to perception systems for task domains such as...
research
11/03/2022

Semantic 3D Grid Maps for Autonomous Driving

Maps play a key role in rapidly developing area of autonomous driving. W...
research
04/18/2019

DDNet: Cartesian-polar Dual-domain Network for the Joint Optic Disc and Cup Segmentation

Existing joint optic disc and cup segmentation approaches are developed ...

Please sign up or login with your details

Forgot password? Click here to reset