Automated Training and Maintenance through Kinect

07/11/2012
by   Saket Warade, et al.
0

In this paper, we have worked on reducing burden on mechanic involving complex automobile maintenance activities that are performed in centralised workshops. We have presented a system prototype that combines Augmented Reality with Kinect. With the use of Kinect, very high quality sensors are available at considerably low costs, thus reducing overall expenditure for system design. The system can be operated either in Speech mode or in Gesture mode. The system can be controlled by various audio commands if user opts for Speech mode. The same controlling can also be done by using a set of Gestures in Gesture mode. Gesture recognition is the task performed by Kinect system. This system, bundled with RGB and Depth camera, processes the skeletal data by keeping track of 20 different body joints. Recognizing Gestures is done by verifying user movements and checking them against predefined condition. Augmented Reality module captures real-time image data streams from high resolution camera. This module then generates 3D model that is superimposed on real time data.

READ FULL TEXT

page 7

page 8

research
07/25/2022

Eliciting Multimodal Gesture+Speech Interactions in a Multi-Object Augmented Reality Environment

As augmented reality technology and hardware become more mature and affo...
research
09/15/2015

Free-body Gesture Tracking and Augmented Reality Improvisation for Floor and Aerial Dance

This paper describes an updated interactive performance system for floor...
research
09/14/2020

Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

This research establishes a better understanding of the syntax choices i...
research
12/15/2017

Holoscopic 3D Micro-Gesture Database for Wearable Device Interaction

With the rapid development of augmented reality (AR) and virtual reality...
research
09/13/2023

User Training with Error Augmentation for Electromyogram-based Gesture Classification

We designed and tested a system for real-time control of a user interfac...
research
11/04/2019

Synthetic Video Generation for Robust Hand Gesture Recognition in Augmented Reality Applications

Hand gestures are a natural means of interaction in Augmented Reality an...
research
06/12/2018

Real-time on-device nod and shake recognition

We discuss methods for teaching systems to identify gestures such as hea...

Please sign up or login with your details

Forgot password? Click here to reset