Pedestrian Detection in Thermal Images using Saliency Maps

04/15/2019
by   Debasmita Ghose, et al.
0

Thermal images are mainly used to detect the presence of people at night or in bad lighting conditions, but perform poorly at daytime. To solve this problem, most state-of-the-art techniques employ a fusion network that uses features from paired thermal and color images. Instead, we propose to augment thermal images with their saliency maps, to serve as an attention mechanism for the pedestrian detector especially during daytime. We investigate how such an approach results in improved performance for pedestrian detection using only thermal images, eliminating the need for paired color images. For our experiments, we train the Faster R-CNN for pedestrian detection and report the added effect of saliency maps generated using static and deep methods (PiCA-Net and R3-Net). Our best performing model results in an absolute reduction of miss rate by 13.4 We also annotate and release pixel level masks of pedestrians on a subset of the KAIST Multispectral Pedestrian Detection dataset, which is a first publicly available dataset for salient pedestrian detection.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 8

research
11/08/2016

Multispectral Deep Neural Networks for Pedestrian Detection

Multispectral pedestrian detection is essential for around-the-clock app...
research
02/17/2023

Cascaded information enhancement and cross-modal attention feature fusion for multispectral pedestrian detection

Multispectral pedestrian detection is a technology designed to detect an...
research
09/26/2016

Linear Support Tensor Machine: Pedestrian Detection in Thermal Infrared Images

Pedestrian detection in thermal infrared images poses unique challenges ...
research
05/07/2019

Generalization ability of region proposal networks for multispectral person detection

Multispectral person detection aims at automatically localizing humans i...
research
05/20/2020

Classifying Suspicious Content in Tor Darknet

One of the tasks of law enforcement agencies is to find evidence of crim...
research
05/26/2021

Spatio-Contextual Deep Network Based Multimodal Pedestrian Detection For Autonomous Driving

Pedestrian Detection is the most critical module of an Autonomous Drivin...
research
03/16/2019

GFD-SSD: Gated Fusion Double SSD for Multispectral Pedestrian Detection

Pedestrian detection is an essential task in autonomous driving research...

Please sign up or login with your details

Forgot password? Click here to reset