DeepAI AI Chat
Log In Sign Up

Performance Monitoring of Object Detection During Deployment

by   Quazi Marufur Rahman, et al.

Performance monitoring of object detection is crucial for safety-critical applications such as autonomous vehicles that operate under varying and complex environmental conditions. Currently, object detectors are evaluated using summary metrics based on a single dataset that is assumed to be representative of all future deployment conditions. In practice, this assumption does not hold, and the performance fluctuates as a function of the deployment conditions. To address this issue, we propose an introspection approach to performance monitoring during deployment without the need for ground truth data. We do so by predicting when the per-frame mean average precision drops below a critical threshold using the detector's internal features. We quantitatively evaluate and demonstrate our method's ability to reduce risk by trading off making an incorrect decision by raising the alarm and absenting from detection.


page 2

page 5

page 6


Online Monitoring of Object Detection Performance Post-Deployment

Post-deployment, an object detector is expected to operate at a similar ...

Risk Ranked Recall: Collision Safety Metric for Object Detection Systems in Autonomous Vehicles

Commonly used metrics for evaluation of object detection systems (precis...

Did You Miss the Sign? A False Negative Alarm System for Traffic Sign Detectors

Object detection is an integral part of an autonomous vehicle for its sa...

Issues in Object Detection in Videos using Common Single-Image CNNs

A growing branch of computer vision is object detection. Object detectio...

Exploring Credibility Scoring Metrics of Perception Systems for Autonomous Driving

Autonomous and semi-autonomous vehicles' perception algorithms can encou...

Safety Metrics and Losses for Object Detection in Autonomous Driving

State-of-the-art object detectors have been shown effective in many appl...

DeepPlastic: A Novel Approach to Detecting Epipelagic Bound Plastic Using Deep Visual Models

The quantification of positively buoyant marine plastic debris is critic...

Code Repositories



view repo