Muscle Vision: Real Time Keypoint Based Pose Classification of Physical Exercises

03/23/2022
by   Alex Moran, et al.
0

Recent advances in machine learning technology have enabled highly portable and performant models for many common tasks, especially in image recognition. One emerging field, 3D human pose recognition extrapolated from video, has now advanced to the point of enabling real-time software applications with robust enough output to support downstream machine learning tasks. In this work we propose a new machine learning pipeline and web interface that performs human pose recognition on a live video feed to detect when common exercises are performed and classify them accordingly. We present a model interface capable of webcam input with live display of classification results. Our main contributions include a keypoint and time series based lightweight approach for classifying a selected set of fitness exercises and a web-based software application for obtaining and visualizing the results in real time.

READ FULL TEXT

page 4

page 5

page 6

research
06/17/2020

BlazePose: On-device Real-time Body Pose tracking

We present BlazePose, a lightweight convolutional neural network archite...
research
08/11/2020

Real-Time Sign Language Detection using Human Pose Estimation

We propose a lightweight real-time sign language detection model, as we ...
research
04/13/2022

Recognition of Freely Selected Keypoints on Human Limbs

Nearly all Human Pose Estimation (HPE) datasets consist of a fixed set o...
research
04/19/2019

Simple yet efficient real-time pose-based action recognition

Recognizing human actions is a core challenge for autonomous systems as ...
research
06/03/2021

ProtoRes: Proto-Residual Architecture for Deep Modeling of Human Pose

Our work focuses on the development of a learnable neural representation...
research
10/12/2022

Gotcha: A Challenge-Response System for Real-Time Deepfake Detection

The integrity of online video interactions is threatened by the widespre...
research
05/26/2019

Technical Report of the Video Event Reconstruction and Analysis (VERA) System - Shooter Localization, Models, Interface, and Beyond

Every minute, hundreds of hours of video are uploaded to social media si...

Please sign up or login with your details

Forgot password? Click here to reset