ObjectLab: Automated Diagnosis of Mislabeled Images in Object Detection Data

09/02/2023
by   Ulyana Tkachenko, et al.
0

Despite powering sensitive systems like autonomous vehicles, object detection remains fairly brittle in part due to annotation errors that plague most real-world training datasets. We propose ObjectLab, a straightforward algorithm to detect diverse errors in object detection labels, including: overlooked bounding boxes, badly located boxes, and incorrect class label assignments. ObjectLab utilizes any trained object detection model to score the label quality of each image, such that mislabeled images can be automatically prioritized for label review/correction. Properly handling erroneous data enables training a better version of the same object detection model, without any change in existing modeling code. Across different object detection datasets (including COCO) and different models (including Detectron-X101 and Faster-RCNN), ObjectLab consistently detects annotation errors with much better precision/recall compared to other label quality scores.

READ FULL TEXT

page 8

page 12

page 13

page 14

page 15

page 16

page 17

page 18

research
11/25/2022

Combating noisy labels in object detection datasets

The quality of training datasets for deep neural networks is a key facto...
research
03/13/2023

Identifying Label Errors in Object Detection Datasets by Loss Inspection

Labeling datasets for supervised object detection is a dull and time-con...
research
07/11/2023

Estimating label quality and errors in semantic segmentation data via any model

The labor-intensive annotation process of semantic segmentation datasets...
research
07/22/2021

An overcome of far-distance limitation on tunnel CCTV-based accident detection in AI deep-learning frameworks

Tunnel CCTVs are installed to low height and long-distance interval. How...
research
10/08/2022

Detecting Label Errors in Token Classification Data

Mislabeled examples are a common issue in real-world data, particularly ...
research
10/01/2018

One-Click Annotation with Guided Hierarchical Object Detection

The increase in data collection has made data annotation an interesting ...
research
10/21/2020

UFO^2: A Unified Framework towards Omni-supervised Object Detection

Existing work on object detection often relies on a single form of annot...

Please sign up or login with your details

Forgot password? Click here to reset