Vision-based Uneven BEV Representation Learning with Polar Rasterization and Surface Estimation

07/05/2022
by   Zhi Liu, et al.
2

In this work, we propose PolarBEV for vision-based uneven BEV representation learning. To adapt to the foreshortening effect of camera imaging, we rasterize the BEV space both angularly and radially, and introduce polar embedding decomposition to model the associations among polar grids. Polar grids are rearranged to an array-like regular representation for efficient processing. Besides, to determine the 2D-to-3D correspondence, we iteratively update the BEV surface based on a hypothetical plane, and adopt height-based feature transformation. PolarBEV keeps real-time inference speed on a single 2080Ti GPU, and outperforms other methods for both BEV semantic segmentation and BEV instance segmentation. Thorough ablations are presented to validate the design. The code will be released at <https://github.com/SuperZ-Liu/PolarBEV>.

READ FULL TEXT

page 8

page 9

research
06/22/2022

Polar Parametrization for Vision-based Surround-View 3D Detection

3D detection based on surround-view camera system is a critical techniqu...
research
04/18/2019

DDNet: Cartesian-polar Dual-domain Network for the Joint Optic Disc and Cup Segmentation

Existing joint optic disc and cup segmentation approaches are developed ...
research
06/30/2022

PolarFormer: Multi-camera 3D Object Detection with Polar Transformers

3D object detection in autonomous driving aims to reason "what" and "whe...
research
05/05/2021

PolarMask++: Enhanced Polar Representation for Single-Shot Instance Segmentation and Beyond

Reducing the complexity of the pipeline of instance segmentation is cruc...
research
06/09/2022

Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformer

Learning Bird's Eye View (BEV) representation from surrounding-view came...
research
03/24/2023

FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentation

This paper raises the new task of Fisheye Semantic Completion (FSC), whe...
research
06/25/2018

Accounting for phenology in the analysis of animal movement

The analysis of animal tracking data provides an important source of sci...

Please sign up or login with your details

Forgot password? Click here to reset