MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models

08/24/2023
by   Xiyue Zhu, et al.
0

Despite tremendous advancements in bird's-eye view (BEV) perception, existing models fall short in generating realistic and coherent semantic map layouts, and they fail to account for uncertainties arising from partial sensor information (such as occlusion or limited coverage). In this work, we introduce MapPrior, a novel BEV perception framework that combines a traditional discriminative BEV perception model with a learned generative model for semantic map layouts. Our MapPrior delivers predictions with better accuracy, realism, and uncertainty awareness. We evaluate our model on the large-scale nuScenes benchmark. At the time of submission, MapPrior outperforms the strongest competing method, with significantly improved MMD and ECE scores in camera- and LiDAR-based BEV perception.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 9

research
01/11/2023

Street-View Image Generation from a Bird's-Eye View Layout

Bird's-Eye View (BEV) Perception has received increasing attention in re...
research
11/19/2020

Batteries, camera, action! Learning a semantic control space for expressive robot cinematography

Aerial vehicles are revolutionizing the way film-makers can capture shot...
research
09/20/2023

BroadBEV: Collaborative LiDAR-camera Fusion for Broad-sighted Bird's Eye View Map Construction

A recent sensor fusion in a Bird's Eye View (BEV) space has shown its ut...
research
06/12/2023

MaskedFusion360: Reconstruct LiDAR Data by Querying Camera Features

In self-driving applications, LiDAR data provides accurate information a...
research
11/15/2022

Monocular BEV Perception of Road Scenes via Front-to-Top View Projection

HD map reconstruction is crucial for autonomous driving. LiDAR-based met...
research
03/07/2023

OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception

Semantic occupancy perception is essential for autonomous driving, as au...
research
07/08/2019

Robust Guarantees for Perception-Based Control

Motivated by vision based control of autonomous vehicles, we consider th...

Please sign up or login with your details

Forgot password? Click here to reset