Numerical Demultiplexing of Color Image Sensor Measurements via Non-linear Random Forest Modeling

12/17/2015
by   Jason Deglint, et al.
0

The simultaneous capture of imaging data at multiple wavelengths across the electromagnetic spectrum is highly challenging, requiring complex and costly multispectral image sensors. In this study, we introduce a comprehensive framework for performing simultaneous multispectral imaging using conventional image sensors with color filter arrays via numerical demultiplexing of the color image sensor measurements. A numerical forward model characterizing the formation of sensor measurements from light spectra hitting the sensor is constructed based on a comprehensive spectral characterization of the sensor. A numerical demultiplexer is then learned via non-linear random forest modeling based on the forward model. Given the learned numerical demultiplexer, one can then demultiplex simultaneously-acquired measurements made by the image sensor into reflectance intensities at discrete selectable wavelengths, resulting in a higher resolution reflectance spectrum. Simulation and real-world experimental results demonstrate the efficacy of such a method for simultaneous multispectral imaging.

READ FULL TEXT

page 1

page 3

research
03/23/2019

Color Filter Arrays for Quanta Image Sensors

Quanta image sensor (QIS) is to be the next generation image sensor afte...
research
02/22/2021

Quantitative photoacoustic oximetry imaging by multiple illumination learned spectral decoloring

Significance: Quantitative measurement of blood oxygen saturation (sO_2)...
research
04/01/2017

A Brownian Motion Model and Extreme Belief Machine for Modeling Sensor Data Measurements

As the title suggests, we will describe (and justify through the present...
research
03/18/2013

Modeling a Sensor to Improve its Efficacy

Robots rely on sensors to provide them with information about their surr...
research
03/03/2023

Longwave infrared multispectral image sensor system using aluminum-germanium plasmonic filter arrays

A multispectral camera records image data in various wavelengths across ...
research
04/03/2022

Forward and backward mapping of image to 2D vector field using fiber bundle color space

We introduce the concept of a fiber bundle color space, which acts accor...
research
05/23/2016

Learning Sensor Multiplexing Design through Back-propagation

Recent progress on many imaging and vision tasks has been driven by the ...

Please sign up or login with your details

Forgot password? Click here to reset