BabyNet: A Lightweight Network for Infant Reaching Action Recognition in Unconstrained Environments to Support Future Pediatric Rehabilitation Applications

08/09/2022
by   Amel Dechemi, et al.
0

Action recognition is an important component to improve autonomy of physical rehabilitation devices, such as wearable robotic exoskeletons. Existing human action recognition algorithms focus on adult applications rather than pediatric ones. In this paper, we introduce BabyNet, a light-weight (in terms of trainable parameters) network structure to recognize infant reaching action from off-body stationary cameras. We develop an annotated dataset that includes diverse reaches performed while in a sitting posture by different infants in unconstrained environments (e.g., in home settings, etc.). Our approach uses the spatial and temporal connection of annotated bounding boxes to interpret onset and offset of reaching, and to detect a complete reaching action. We evaluate the efficiency of our proposed approach and compare its performance against other learning-based network structures in terms of capability of capturing temporal inter-dependencies and accuracy of detection of reaching onset and offset. Results indicate our BabyNet can attain solid performance in terms of (average) testing accuracy that exceeds that of other larger networks, and can hence serve as a light-weight data-driven framework for video-based infant reaching action recognition.

READ FULL TEXT

page 2

page 3

page 4

page 6

research
12/19/2021

Precondition and Effect Reasoning for Action Recognition

Human action recognition has drawn a lot of attention in the recent year...
research
02/09/2020

FSD-10: A Dataset for Competitive Sports Content Analysis

Action recognition is an important and challenging problem in video anal...
research
07/30/2015

Action recognition in still images by latent superpixel classification

Action recognition from still images is an important task of computer vi...
research
09/30/2022

Application-Driven AI Paradigm for Human Action Recognition

Human action recognition in computer vision has been widely studied in r...
research
09/17/2023

CaSAR: Contact-aware Skeletal Action Recognition

Skeletal Action recognition from an egocentric view is important for app...
research
06/19/2019

An Action Recognition network for specific target based on rMC and RPN

The traditional methods of action recognition are not specific for the o...
research
07/02/2020

Low-light Environment Neural Surveillance

We design and implement an end-to-end system for real-time crime detecti...

Please sign up or login with your details

Forgot password? Click here to reset