MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?

08/21/2021
by   Matteo Fabbri, et al.
3

Deep learning-based methods for video pedestrian detection and tracking require large volumes of training data to achieve good performance. However, data acquisition in crowded public environments raises data privacy concerns – we are not allowed to simply record and store data without the explicit consent of all participants. Furthermore, the annotation of such data for computer vision applications usually requires a substantial amount of manual effort, especially in the video domain. Labeling instances of pedestrians in highly crowded scenarios can be challenging even for human annotators and may introduce errors in the training data. In this paper, we study how we can advance different aspects of multi-person tracking using solely synthetic data. To this end, we generate MOTSynth, a large, highly diverse synthetic dataset for object detection and tracking using a rendering game engine. Our experiments show that MOTSynth can be used as a replacement for real data on tasks such as pedestrian detection, re-identification, segmentation, and tracking.

READ FULL TEXT

page 1

page 3

page 14

page 15

research
07/21/2023

ParGANDA: Making Synthetic Pedestrians A Reality For Object Detection

Object detection is the key technique to a number of Computer Vision app...
research
06/20/2023

Data-Driven but Privacy-Conscious: Pedestrian Dataset De-identification via Full-Body Person Synthesis

The advent of data-driven technology solutions is accompanied by an incr...
research
05/16/2020

Towards in-store multi-person tracking using head detection and track heatmaps

Computer vision algorithms are being implemented across a breadth of ind...
research
09/06/2023

Active shooter detection and robust tracking utilizing supplemental synthetic data

The increasing concern surrounding gun violence in the United States has...
research
07/22/2022

Neural-Sim: Learning to Generate Training Data with NeRF

Training computer vision models usually requires collecting and labeling...
research
12/14/2021

Birds Eye View Social Distancing Analysis System

Social distancing can reduce the infection rates in respiratory pandemic...
research
09/06/2016

Automation of Pedestrian Tracking in a Crowded Situation

Studies on microscopic pedestrian requires large amounts of trajectory d...

Please sign up or login with your details

Forgot password? Click here to reset