Deep-learning-based Hyperspectral imaging through a RGB camera

07/12/2021
by   Xinyu Gao, et al.
10

Hyperspectral image (HSI) contains both spatial pattern and spectral information which has been widely used in food safety, remote sensing, and medical detection. However, the acquisition of hyperspectral images is usually costly due to the complicated apparatus for the acquisition of optical spectrum. Recently, it has been reported that HSI can be reconstructed from single RGB image using convolution neural network (CNN) algorithms. Compared with the traditional hyperspectral cameras, the method based on CNN algorithms is simple, portable and low cost. In this study, we focused on the influence of the RGB camera spectral sensitivity (CSS) on the HSI. A Xenon lamp incorporated with a monochromator were used as the standard light source to calibrate the CSS. And the experimental results show that the CSS plays a significant role in the reconstruction accuracy of an HSI. In addition, we proposed a new HSI reconstruction network where the dimensional structure of the original hyperspectral datacube was modified by 3D matrix transpose to improve the reconstruction accuracy.

READ FULL TEXT

page 4

page 5

page 8

page 10

page 11

research
06/30/2021

Learnable Reconstruction Methods from RGB Images to Hyperspectral Imaging: A Survey

Hyperspectral imaging enables versatile applications due to its competen...
research
04/08/2022

Deep Hyperspectral-Depth Reconstruction Using Single Color-Dot Projection

Depth reconstruction and hyperspectral reflectance reconstruction are tw...
research
09/05/2022

Wavelength-aware 2D Convolutions for Hyperspectral Imaging

Deep Learning could drastically boost the classification accuracy for Hy...
research
08/03/2023

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

Deep learning methods are developing rapidly in coded aperture snapshot ...
research
11/18/2021

A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restoration

Hyperspectral imaging offers new perspectives for diverse applications, ...
research
03/26/2021

Tuning IR-cut Filter for Illumination-aware Spectral Reconstruction from RGB

To reconstruct spectral signals from multi-channel observations, in part...
research
02/17/2023

Apple scab detection in orchards using deep learning on colour and multispectral images

Apple scab is a fungal disease caused by Venturia inaequalis. Disease is...

Please sign up or login with your details

Forgot password? Click here to reset