A Step Toward More Inclusive People Annotations for Fairness

05/05/2021
by   Candice Schumann, et al.
7

The Open Images Dataset contains approximately 9 million images and is a widely accepted dataset for computer vision research. As is common practice for large datasets, the annotations are not exhaustive, with bounding boxes and attribute labels for only a subset of the classes in each image. In this paper, we present a new set of annotations on a subset of the Open Images dataset called the MIAP (More Inclusive Annotations for People) subset, containing bounding boxes and attributes for all of the people visible in those images. The attributes and labeling methodology for the MIAP subset were designed to enable research into model fairness. In addition, we analyze the original annotation methodology for the person class and its subclasses, discussing the resulting patterns in order to inform future annotation efforts. By considering both the original and exhaustive annotation sets, researchers can also now study how systematic patterns in training annotations affect modeling.

READ FULL TEXT

page 4

page 5

page 6

page 8

research
08/31/2023

FACET: Fairness in Computer Vision Evaluation Benchmark

Computer vision models have known performance disparities across attribu...
research
12/23/2020

Efficient video annotation with visual interpolation and frame selection guidance

We introduce a unified framework for generic video annotation with bound...
research
10/20/2021

Noisy Annotation Refinement for Object Detection

Supervised training of object detectors requires well-annotated large-sc...
research
08/09/2017

Extreme clicking for efficient object annotation

Manually annotating object bounding boxes is central to building compute...
research
03/07/2023

A Method for Animating Children's Drawings of the Human Figure

Children's drawings have a wonderful inventiveness, creativity, and vari...
research
07/22/2022

Evaluation of Different Annotation Strategies for Deployment of Parking Spaces Classification Systems

When using vision-based approaches to classify individual parking spaces...
research
06/14/2023

FROG: A new people detection dataset for knee-high 2D range finders

Mobile robots require knowledge of the environment, especially of humans...

Please sign up or login with your details

Forgot password? Click here to reset