Human action recognition with a large-scale brain-inspired photonic computer

04/06/2020
by   Piotr Antonik, et al.
21

The recognition of human actions in video streams is a challenging task in computer vision, with cardinal applications in e.g. brain-computer interface and surveillance. Deep learning has shown remarkable results recently, but can be found hard to use in practice, as its training requires large datasets and special purpose, energy-consuming hardware. In this work, we propose a scalable photonic neuro-inspired architecture based on the reservoir computing paradigm, capable of recognising video-based human actions with state-of-the-art accuracy. Our experimental optical setup comprises off-the-shelf components, and implements a large parallel recurrent neural network that is easy to train and can be scaled up to hundreds of thousands of nodes. This work paves the way towards simply reconfigurable and energy-efficient photonic information processing systems for real-time video processing.

READ FULL TEXT

page 1

page 4

page 7

page 9

research
05/24/2023

High Speed Human Action Recognition using a Photonic Reservoir Computer

The recognition of human actions in videos is one of the most active res...
research
03/21/2018

Learning and Recognizing Human Action from Skeleton Movement with Deep Residual Neural Networks

Automatic human action recognition is indispensable for almost artificia...
research
06/27/2017

Recurrent Residual Learning for Action Recognition

Action recognition is a fundamental problem in computer vision with a lo...
research
12/26/2020

Faster and Accurate Compressed Video Action Recognition Straight from the Frequency Domain

Human action recognition has become one of the most active field of rese...
research
12/29/2013

Actions in the Eye: Dynamic Gaze Datasets and Learnt Saliency Models for Visual Recognition

Systems based on bag-of-words models from image features collected at ma...
research
08/22/2017

Human Action Recognition System using Good Features and Multilayer Perceptron Network

Human action recognition involves the characterization of human actions ...
research
01/06/2022

A unified software/hardware scalable architecture for brain-inspired computing based on self-organizing neural models

The field of artificial intelligence has significantly advanced over the...

Please sign up or login with your details

Forgot password? Click here to reset