A Parallel Implementation of Computing Mean Average Precision

06/19/2022
by   Beinan Wang, et al.
0

Mean Average Precision (mAP) has been widely used for evaluating the quality of object detectors, but an efficient implementation is still absent. Current implementations can only count true positives (TP's) and false positives (FP's) for one class at a time by looping through every detection of that class sequentially. Not only are these approaches inefficient, but they are also inconvenient for reporting validation mAP during training. We propose a parallelized alternative that can process mini-batches of detected bounding boxes (DTBB's) and ground truth bounding boxes (GTBB's) as inference goes such that mAP can be instantly calculated after inference is finished. Loops and control statements in sequential implementations are replaced with extensive uses of broadcasting, masking, and indexing. All operators involved are supported by popular machine learning frameworks such as PyTorch and TensorFlow. As a result, our implementation is much faster and can easily fit into typical training routines. A PyTorch version of our implementation is available at https://github.com/bwangca/fast-map.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2021

Confidence Propagation Cluster: Unleash Full Potential of Object Detectors

It has been a long history that most object detection methods obtain obj...
research
07/21/2022

Efficient Graph-Friendly COCO Metric Computation for Train-Time Model Evaluation

Evaluating the COCO mean average precision (MaP) and COCO recall metrics...
research
06/15/2022

LET-3D-AP: Longitudinal Error Tolerant 3D Average Precision for Camera-Only 3D Detection

The popular object detection metric 3D Average Precision (3D AP) relies ...
research
05/12/2020

IterDet: Iterative Scheme for ObjectDetection in Crowded Environments

Deep learning-based detectors usually produce a redundant set of object ...
research
07/28/2020

Quantum-soft QUBO Suppression for Accurate Object Detection

Non-maximum suppression (NMS) has been adopted by default for removing r...
research
12/14/2020

FasteNet: A Fast Railway Fastener Detector

In this work, a novel high-speed railway fastener detector is introduced...
research
05/28/2023

Bayesian Decision Making to Localize Visual Queries in 2D

This report describes our approach for the EGO4D 2023 Visual Query 2D Lo...

Please sign up or login with your details

Forgot password? Click here to reset