Log In Sign Up

The efficacy of Neural Planning Metrics: A meta-analysis of PKL on nuScenes

by   Yiluan Guo, et al.

A high-performing object detection system plays a crucial role in autonomous driving (AD). The performance, typically evaluated in terms of mean Average Precision, does not take into account orientation and distance of the actors in the scene, which are important for the safe AD. It also ignores environmental context. Recently, Philion et al. proposed a neural planning metric (PKL), based on the KL divergence of a planner's trajectory and the groundtruth route, to accommodate these requirements. In this paper, we use this neural planning metric to score all submissions of the nuScenes detection challenge and analyze the results. We find that while somewhat correlated with mAP, the PKL metric shows different behavior to increased traffic density, ego velocity, road curvature and intersections. Finally, we propose ideas to extend the neural planning metric.


page 1

page 2

page 3

page 4


Informed sampling-based trajectory planner for automated driving in dynamic urban environments

The urban environment is amongst the most difficult domains for autonomo...

A Data-Driven Approach for Autonomous Motion Planning and Control in Off-Road Driving Scenarios

This paper presents a novel data-driven approach to vehicle motion plann...

Context-Aware Scene Prediction Network (CASPNet)

Predicting the future motion of surrounding road users is a crucial and ...

Meta Guided Metric Learner for Overcoming Class Confusion in Few-Shot Road Object Detection

Localization and recognition of less-occurring road objects have been a ...

Safety Metrics and Losses for Object Detection in Autonomous Driving

State-of-the-art object detectors have been shown effective in many appl...

Learning to Evaluate Perception Models Using Planner-Centric Metrics

Variants of accuracy and precision are the gold-standard by which the co...

Autonomous Passage Planning for a Polar Vessel

We introduce a method for long-distance maritime route planning in polar...

Code Repositories


Learning to Evaluate Perception Models Using Planner-Centric Metrics

view repo