Ultrafast single-channel machine vision based on neuro-inspired photonic computing

02/15/2023
by   Tomoya Yamaguchi, et al.
0

High-speed machine vision is increasing its importance in both scientific and technological applications. Neuro-inspired photonic computing is a promising approach to speed-up machine vision processing with ultralow latency. However, the processing rate is fundamentally limited by the low frame rate of image sensors, typically operating at tens of hertz. Here, we propose an image-sensor-free machine vision framework, which optically processes real-world visual information with only a single input channel, based on a random temporal encoding technique. This approach allows for compressive acquisitions of visual information with a single channel at gigahertz rates, outperforming conventional approaches, and enables its direct photonic processing using a photonic reservoir computer in a time domain. We experimentally demonstrate that the proposed approach is capable of high-speed image recognition and anomaly detection, and furthermore, it can be used for high-speed imaging. The proposed approach is multipurpose and can be extended for a wide range of applications, including tracking, controlling, and capturing sub-nanosecond phenomena.

READ FULL TEXT

page 17

page 18

page 19

page 20

page 22

page 25

page 28

page 30

research
07/20/2019

A Retina-inspired Sampling Method for Visual Texture Reconstruction

Conventional frame-based camera is not able to meet the demand of rapid ...
research
06/12/2023

Intelligent Multi-channel Meta-imagers for Accelerating Machine Vision

Rapid developments in machine vision have led to advances in a variety o...
research
05/22/2021

Photonic neural field on a silicon chip: large-scale, high-speed neuro-inspired computing and sensing

Photonic neural networks have significant potential for high-speed neura...
research
01/05/2022

Neuromorphic Vision Based Control for the Precise Positioning of Robotic Drilling Systems

The manufacturing industry is currently witnessing a paradigm shift with...
research
02/11/2022

Meta-learning with GANs for anomaly detection, with deployment in high-speed rail inspection system

Anomaly detection has been an active research area with a wide range of ...
research
02/06/2020

IlluminatedFocus: Vision Augmentation using Spatial Defocusing via Focal Sweep Eyeglasses and High-Speed Projector

Aiming at realizing novel vision augmentation experiences, this paper pr...
research
05/24/2023

High Speed Human Action Recognition using a Photonic Reservoir Computer

The recognition of human actions in videos is one of the most active res...

Please sign up or login with your details

Forgot password? Click here to reset