Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns

by   Youngjun Cho, et al.

We introduce Deep Thermal Imaging, a new approach for close-range automatic recognition of materials to enhance the understanding of people and ubiquitous technologies of their proximal environment. Our approach uses a low-cost mobile thermal camera integrated into a smartphone to capture thermal textures. A deep neural network classifies these textures into material types. This approach works effectively without the need for ambient light sources or direct contact with materials. Furthermore, the use of a deep learning network removes the need to handcraft the set of features for different materials. We evaluated the performance of the system by training it to recognise 32 material types in both indoor and outdoor environments. Our approach produced recognition accuracies above 98 images of 17 outdoor materials. We conclude by discussing its potentials for real-time use in HCI applications and future directions.



There are no comments yet.


page 1

page 3

page 5

page 6

page 7

page 8

page 9


A Model that Predicts the Material Recognition Performance of Thermal Tactile Sensing

Tactile sensing can enable a robot to infer properties of its surroundin...

Deep Learning of Superconductors I: Estimation of Critical Temperature of Superconductors Toward the Search for New Materials

High-temperature superconductors have a lot of promising applications: q...

Estimating physical properties from liquid crystal textures via machine learning and complexity-entropy methods

Imaging techniques are essential tools for inquiring a number of propert...

Impact of Thermal Throttling on Long-Term Visual Inference in a CPU-based Edge Device

Many application scenarios of edge visual inference, e.g., robotics or e...

Physiological and Affective Computing through Thermal Imaging: A Survey

Thermal imaging-based physiological and affective computing is an emergi...

Effects of Illumination on the Categorization of Shiny Materials

The present research was designed to examine how patterns of illuminatio...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.