Fusion of Real Time Thermal Image and 1D/2D/3D Depth Laser Readings for Remote Thermal Sensing in Industrial Plants by Means of UAVs and/or Robots

06/01/2020
by   Corneliu Arsene, et al.
0

This paper presents fast procedures for thermal infrared remote sensing in dark, GPS-denied environments, such as those found in industrial plants such as in High-Voltage Direct Current (HVDC) converter stations. These procedures are based on the combination of the depth estimation obtained from either a 1-Dimensional LIDAR laser or a 2-Dimensional Hokuyo laser or a 3D MultiSense SLB laser sensor and the visible and thermal cameras from a FLIR Duo R dual-sensor thermal camera. The combination of these sensors/cameras is suitable to be mounted on Unmanned Aerial Vehicles (UAVs) and/or robots in order to provide reliable information about the potential malfunctions, which can be found within the hazardous environment. For example, the capabilities of the developed software and hardware system corresponding to the combination of the 1-D LIDAR sensor and the FLIR Duo R dual-sensor thermal camera is assessed from the point of the accuracy of results and the required computational times: the obtained computational times are under 10 ms, with a maximum localization error of 8 mm and an average standard deviation for the measured temperatures of 1.11 degree Celsius, which results are obtained for a number of test cases. The paper is structured as follows: the description of the system used for identification and localization of hotspots in industrial plants is presented in section II. In section III, the method for faults identification and localization in plants by using a 1-Dimensional LIDAR laser sensor and thermal images is described together with results. In section IV the real time thermal image processing is presented. Fusion of the 2-Dimensional depth laser Hokuyo and the thermal images is described in section V. In section VI the combination of the 3D MultiSense SLB laser and thermal images is described. In section VII a discussion and several conclusions are drawn.

READ FULL TEXT

page 5

page 12

page 13

page 16

page 17

page 18

page 20

page 21

research
09/28/2021

Targetless Extrinsic Calibration of Stereo Cameras, Thermal Cameras, and Laser Sensors in the Wild

The fusion of multi-modal sensors has become increasingly popular in aut...
research
03/03/2023

Towards a Procedure Optimised Steerable Microcatheter for Deep Seated Neurosurgery

In recent years, the steerable needles have attracted significant intere...
research
10/29/2019

Toward Underground Localization: Lidar Inertial Odometry Enabled Aerial Robot Navigation

Localization can be achieved by different sensors and techniques such as...
research
07/03/2020

Complexity matters: highly-accurate numerical models of coupled radiative-conductive heat transfer in a laser flash experiment

Thermal diffusivity measurements of samples transmitting thermal radiati...
research
03/05/2019

Visual-Thermal Landmarks and Inertial Fusion for Navigation in Degraded Visual Environments

With an ever-widening domain of aerial robotic applications, including m...
research
10/18/2022

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation

Unmanned aerial vehicles (UAVs) equipped with multiple complementary sen...
research
01/27/2022

Edge effects in radial porosity profiles from CT measurements and melt pool signal intensities for laser powder bed fusion

Limited process control can cause metallurgical defect formation and inh...

Please sign up or login with your details

Forgot password? Click here to reset