DeepAI AI Chat
Log In Sign Up

Ultrafast single-channel machine vision based on neuro-inspired photonic computing

by   Tomoya Yamaguchi, et al.
Kanazawa University

High-speed machine vision is increasing its importance in both scientific and technological applications. Neuro-inspired photonic computing is a promising approach to speed-up machine vision processing with ultralow latency. However, the processing rate is fundamentally limited by the low frame rate of image sensors, typically operating at tens of hertz. Here, we propose an image-sensor-free machine vision framework, which optically processes real-world visual information with only a single input channel, based on a random temporal encoding technique. This approach allows for compressive acquisitions of visual information with a single channel at gigahertz rates, outperforming conventional approaches, and enables its direct photonic processing using a photonic reservoir computer in a time domain. We experimentally demonstrate that the proposed approach is capable of high-speed image recognition and anomaly detection, and furthermore, it can be used for high-speed imaging. The proposed approach is multipurpose and can be extended for a wide range of applications, including tracking, controlling, and capturing sub-nanosecond phenomena.


page 17

page 18

page 19

page 20

page 22

page 25

page 28

page 30


A Retina-inspired Sampling Method for Visual Texture Reconstruction

Conventional frame-based camera is not able to meet the demand of rapid ...

Photonic neural field on a silicon chip: large-scale, high-speed neuro-inspired computing and sensing

Photonic neural networks have significant potential for high-speed neura...

Neuromorphic Vision Based Control for the Precise Positioning of Robotic Drilling Systems

The manufacturing industry is currently witnessing a paradigm shift with...

Event-Based high-speed low-latency fiducial marker tracking

Motion and dynamic environments, especially under challenging lighting c...

Meta-learning with GANs for anomaly detection, with deployment in high-speed rail inspection system

Anomaly detection has been an active research area with a wide range of ...

Convolutional sparse coding for capturing high speed video content

Video capture is limited by the trade-off between spatial and temporal r...

High-speed object detection with a single-photon time-of-flight image sensor

3D time-of-flight (ToF) imaging is used in a variety of applications suc...