Neural network-based on-chip spectroscopy using a scalable plasmonic encoder

by   Calvin Brown, et al.

Conventional spectrometers are limited by trade-offs set by size, cost, signal-to-noise ratio (SNR), and spectral resolution. Here, we demonstrate a deep learning-based spectral reconstruction framework, using a compact and low-cost on-chip sensing scheme that is not constrained by the design trade-offs inherent to grating-based spectroscopy. The system employs a plasmonic spectral encoder chip containing 252 different tiles of nanohole arrays fabricated using a scalable and low-cost imprint lithography method, where each tile has a unique geometry and, thus, a unique optical transmission spectrum. The illumination spectrum of interest directly impinges upon the plasmonic encoder, and a CMOS image sensor captures the transmitted light, without any lenses, gratings, or other optical components in between, making the entire hardware highly compact, light-weight and field-portable. A trained neural network then reconstructs the unknown spectrum using the transmitted intensity information from the spectral encoder in a feed-forward and non-iterative manner. Benefiting from the parallelization of neural networks, the average inference time per spectrum is  28 microseconds, which is orders of magnitude faster compared to other computational spectroscopy approaches. When blindly tested on unseen new spectra (N = 14,648) with varying complexity, our deep-learning based system identified 96.86 average peak localization error, bandwidth error, and height error of 0.19 nm, 0.18 nm, and 7.60 fabrication defects that may arise during the imprint lithography process, which further makes it ideal for applications that demand cost-effective, field-portable and sensitive high-resolution spectroscopy tools.


page 13

page 14

page 15

page 17


Snapshot Multispectral Imaging Using a Diffractive Optical Network

Multispectral imaging has been used for numerous applications in e.g., e...

High Sensitivity Snapshot Spectrometer Based on Deep Network Unmixing

In this paper, we present a convolution neural network based method to r...

Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data

Optical Coherence Tomography (OCT) is a widely used non-invasive biomedi...

Successive Refinement of Images with Deep Joint Source-Channel Coding

We introduce deep learning based communication methods for successive re...

Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Coding

We introduce deep learning based communication methods for adaptive-band...

Experimental comparison of single-pixel imaging algorithms

Single-pixel imaging (SPI) is a novel technique capturing 2D images usin...

Learning Diffractive Optical Communication Around Arbitrary Opaque Occlusions

Free-space optical systems are emerging for high data rate communication...

Please sign up or login with your details

Forgot password? Click here to reset