Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

by   Yifan Zhuang, et al.

Accurate and efficient pedestrian detection is crucial for the intelligent transportation system regarding pedestrian safety and mobility, e.g., Advanced Driver Assistance Systems, and smart pedestrian crosswalk systems. Among all pedestrian detection methods, vision-based detection method is demonstrated to be the most effective in previous studies. However, the existing vision-based pedestrian detection algorithms still have two limitations that restrict their implementations, those being real-time performance as well as the resistance to the impacts of environmental factors, e.g., low illumination conditions. To address these issues, this study proposes a lightweight Illumination and Temperature-aware Multispectral Network (IT-MN) for accurate and efficient pedestrian detection. The proposed IT-MN is an efficient one-stage detector. For accommodating the impacts of environmental factors and enhancing the sensing accuracy, thermal image data is fused by the proposed IT-MN with visual images to enrich useful information when visual image quality is limited. In addition, an innovative and effective late fusion strategy is also developed to optimize the image fusion performance. To make the proposed model implementable for edge computing, the model quantization is applied to reduce the model size by 75 algorithm is evaluated by comparing with the selected state-of-the-art algorithms using a public dataset collected by in-vehicle cameras. The results show that the proposed algorithm achieves a low miss rate and inference time at 14.19 achieves an inference time of 0.21 seconds per image pair on the edge device, which also demonstrates the potentiality of deploying the proposed model on edge devices as a highly efficient pedestrian detection algorithm.


page 1

page 5

page 6

page 8

page 13


Illumination-aware Faster R-CNN for Robust Multispectral Pedestrian Detection

Multispectral images of color-thermal pairs have shown more effective th...

Pedestrain detection for low-light vision proposal

The demand for pedestrian detection has created a challenging problem fo...

Using Statistical Models to Detect Occupancy in Buildings through Monitoring VOC, CO_2, and other Environmental Factors

Dynamic models of occupancy patterns have shown to be effective in optim...

TFDet: Target-aware Fusion for RGB-T Pedestrian Detection

Pedestrian detection is a critical task in computer vision because of it...

Real-time Pedestrian Detection Approach with an Efficient Data Communication Bandwidth Strategy

Vehicle-to-Pedestrian (V2P) communication can significantly improve pede...

Object Detection in Thermal Spectrum for Advanced Driver-Assistance Systems (ADAS)

Object detection in thermal infrared spectrum provides more reliable dat...

Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection

This paper presents a novel end-to-end system for pedestrian detection u...

Please sign up or login with your details

Forgot password? Click here to reset