Online Monitoring of Object Detection Performance Post-Deployment

11/16/2020
by   Quazi Marufur Rahman, et al.
11

Post-deployment, an object detector is expected to operate at a similar level of performance that was reported on its testing dataset. However, when deployed onboard mobile robots that operate under varying and complex environmental conditions, the detector's performance can fluctuate and occasionally degrade severely without warning. Undetected, this can lead the robot to take unsafe and risky actions based on low-quality and unreliable object detections. We address this problem and introduce a cascaded neural network that monitors the performance of the object detector by predicting the quality of its mean average precision (mAP) on a sliding window of the input frames. The proposed cascaded network exploits the internal features from the deep neural network of the object detector. We evaluate our proposed approach using different combinations of autonomous driving datasets and object detectors.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

09/18/2020

Performance Monitoring of Object Detection During Deployment

Performance monitoring of object detection is crucial for safety-critica...
05/04/2021

Robustness Enhancement of Object Detection in Advanced Driver Assistance Systems (ADAS)

A unified system integrating a compact object detector and a surrounding...
09/30/2018

CaTDet: Cascaded Tracked Detector for Efficient Object Detection from Video

Detecting objects in a video is a compute-intensive task. In this paper ...
03/10/2021

MapFusion: A General Framework for 3D Object Detection with HDMaps

3D object detection is a key perception component in autonomous driving....
04/17/2018

Training a Binary Weight Object Detector by Knowledge Transfer for Autonomous Driving

Autonomous driving has harsh requirements of small model size and energy...
08/07/2017

What Makes a Place? Building Bespoke Place Dependent Object Detectors for Robotics

This paper is about enabling robots to improve their perceptual performa...
11/17/2020

Modality-Buffet for Real-Time Object Detection

Real-time object detection in videos using lightweight hardware is a cru...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.