What's in the Black Box? The False Negative Mechanisms Inside Object Detectors

03/15/2022
by   Dimity Miller, et al.
13

In object detection, false negatives arise when a detector fails to detect a target object. To understand why object detectors produce false negatives, we identify five 'false negative mechanisms', where each mechanism describes how a specific component inside the detector architecture failed. Focusing on two-stage and one-stage anchor-box object detector architectures, we introduce a framework for quantifying these false negative mechanisms. Using this framework, we investigate why Faster R-CNN and RetinaNet fail to detect objects in benchmark vision datasets and robotics datasets. We show that a detector's false negative mechanisms differ significantly between computer vision benchmark datasets and robotics deployment scenarios. This has implications for the translation of object detectors developed for benchmark datasets to robotics applications.

READ FULL TEXT

page 1

page 3

page 7

research
03/15/2019

Did You Miss the Sign? A False Negative Alarm System for Traffic Sign Detectors

Object detection is an integral part of an autonomous vehicle for its sa...
research
04/03/2021

Uncertainty for Identifying Open-Set Errors in Visual Object Detection

Deployed into an open world, object detectors are prone to a type of fal...
research
06/05/2020

Black-box Explanation of Object Detectors via Saliency Maps

We propose D-RISE, a method for generating visual explanations for the p...
research
10/29/2020

Black-Box Optimization of Object Detector Scales

Object detectors have improved considerably in the last years by using a...
research
09/28/2021

Sample-Efficient Safety Assurances using Conformal Prediction

When deploying machine learning models in high-stakes robotics applicati...
research
03/13/2018

Target Driven Instance Detection

While state-of-the-art general object detectors are getting better and b...
research
08/06/2023

Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objects

Camouflaged object detection (COD) is the challenging task of identifyin...

Please sign up or login with your details

Forgot password? Click here to reset