Evaluation of Thermal Imaging on Embedded GPU Platforms for Application in Vehicular Assistance Systems

01/05/2022
by   Muhammad Ali Farooq, et al.
13

This study is focused on evaluating the real-time performance of thermal object detection for smart and safe vehicular systems by deploying the trained networks on GPU single-board EDGE-GPU computing platforms for onboard automotive sensor suite testing. A novel large-scale thermal dataset comprising of > 35,000 distinct frames is acquired, processed, and open-sourced in challenging weather and environmental scenarios. The dataset is a recorded from lost-cost yet effective uncooled LWIR thermal camera, mounted stand-alone and on an electric vehicle to minimize mechanical vibrations. State-of-the-art YOLO-V5 networks variants are trained using four different public datasets as well newly acquired local dataset for optimal generalization of DNN by employing SGD optimizer. The effectiveness of trained networks is validated on extensive test data using various quantitative metrics which include precision, recall curve, mean average precision, and frames per second. The smaller network variant of YOLO is further optimized using TensorRT inference accelerator to explicitly boost the frames per second rate. Optimized network engine increases the frames per second rate by 3.5 times when testing on low power edge devices thus achieving 11 fps on Nvidia Jetson Nano and 60 fps on Nvidia Xavier NX development boards.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 8

page 9

page 10

page 11

research
01/18/2023

Development, Optimization, and Deployment of Thermal Forward Vision Systems for Advance Vehicular Applications on Edge Devices

In this research work, we have proposed a thermal tiny-YOLO multi-class ...
research
09/20/2021

Object Detection in Thermal Spectrum for Advanced Driver-Assistance Systems (ADAS)

Object detection in thermal infrared spectrum provides more reliable dat...
research
06/01/2020

Thermal Object Detection using Domain Adaptation through Style Consistency

A recent fatal accident of an autonomous vehicle opens a debate about th...
research
06/25/2019

SkyNet: A Champion Model for DAC-SDC on Low Power Object Detection

Developing artificial intelligence (AI) at the edge is always challengin...
research
04/11/2023

The MONET dataset: Multimodal drone thermal dataset recorded in rural scenarios

We present MONET, a new multimodal dataset captured using a thermal came...

Please sign up or login with your details

Forgot password? Click here to reset