Tracking Passengers and Baggage Items using Multiple Overhead Cameras at Security Checkpoints

12/31/2022
by   Abubakar Siddique, et al.
9

We introduce a novel framework to track multiple objects in overhead camera videos for airport checkpoint security scenarios where targets correspond to passengers and their baggage items. We propose a Self-Supervised Learning (SSL) technique to provide the model information about instance segmentation uncertainty from overhead images. Our SSL approach improves object detection by employing a test-time data augmentation and a regression-based, rotation-invariant pseudo-label refinement technique. Our pseudo-label generation method provides multiple geometrically-transformed images as inputs to a Convolutional Neural Network (CNN), regresses the augmented detections generated by the network to reduce localization errors, and then clusters them using the mean-shift algorithm. The self-supervised detector model is used in a single-camera tracking algorithm to generate temporal identifiers for the targets. Our method also incorporates a multi-view trajectory association mechanism to maintain consistent temporal identifiers as passengers travel across camera views. An evaluation of detection, tracking, and association performances on videos obtained from multiple overhead cameras in a realistic airport checkpoint environment demonstrates the effectiveness of the proposed approach. Our results show that self-supervision improves object detection accuracy by up to 42% without increasing the inference time of the model. Our multi-camera association method achieves up to 89% multi-object tracking accuracy with an average computation time of less than 15 ms.

READ FULL TEXT

page 3

page 4

page 7

page 8

page 9

page 10

page 14

page 16

research
07/15/2020

Tracking Passengers and Baggage Items using Multi-camera Systems at Security Checkpoints

We introduce a novel tracking-by-detection framework to track multiple o...
research
02/05/2021

Custom Object Detection via Multi-Camera Self-Supervised Learning

This paper proposes MCSSL, a self-supervised learning approach for build...
research
11/17/2022

Multi-Camera Multi-Object Tracking on the Move via Single-Stage Global Association Approach

The development of autonomous vehicles generates a tremendous demand for...
research
01/25/2019

Multiple Hypothesis Tracking Algorithm for Multi-Target Multi-Camera Tracking with Disjoint Views

In this study, a multiple hypothesis tracking (MHT) algorithm for multi-...
research
03/04/2022

Time-to-Label: Temporal Consistency for Self-Supervised Monocular 3D Object Detection

Monocular 3D object detection continues to attract attention due to the ...
research
11/22/2021

Tracking Grow-Finish Pigs Across Large Pens Using Multiple Cameras

Increasing demand for meat products combined with farm labor shortages h...
research
09/10/2022

Self-supervised Learning for Panoptic Segmentation of Multiple Fruit Flower Species

Convolutional neural networks trained using manually generated labels ar...

Please sign up or login with your details

Forgot password? Click here to reset