Effective Gesture Based Framework for Capturing User Input

08/01/2022
by   Pabbathi Sri Charan, et al.
7

Computers today aren't just confined to laptops and desktops. Mobile gadgets like mobile phones and laptops also make use of it. However, one input device that hasn't changed in the last 50 years is the QWERTY keyboard. Users of virtual keyboards can type on any surface as if it were a keyboard thanks to sensor technology and artificial intelligence. In this research, we use the idea of image processing to create an application for seeing a computer keyboard using a novel framework which can detect hand gestures with precise accuracy while also being sustainable and financially viable. A camera is used to capture keyboard images and finger movements which subsequently acts as a virtual keyboard. In addition, a visible virtual mouse that accepts finger coordinates as input is also described in this study. This system has a direct benefit of reducing peripheral cost, reducing electronics waste generated due to external devices and providing accessibility to people who cannot use the traditional keyboard and mouse.

READ FULL TEXT

page 6

page 7

research
07/06/2022

Real-Time Gesture Recognition with Virtual Glove Markers

Due to the universal non-verbal natural communication approach that allo...
research
09/08/2023

SynthoGestures: A Novel Framework for Synthetic Dynamic Hand Gesture Generation for Driving Scenarios

Creating a diverse and comprehensive dataset of hand gestures for dynami...
research
02/22/2022

Comparing Controller With the Hand Gestures Pinch and Grab for Picking Up and Placing Virtual Objects

Grabbing virtual objects is one of the essential tasks for Augmented, Vi...
research
09/02/2022

In-Place Gestures Classification via Long-term Memory Augmented Network

In-place gesture-based virtual locomotion techniques enable users to con...
research
05/14/2022

Efficient Gesture Recognition for the Assistance of Visually Impaired People using Multi-Head Neural Networks

This paper proposes an interactive system for mobile devices controlled ...
research
05/28/2023

IoT based Personal Voice Assistant

Today, technological advancement is increasing day by day. Earlier, ther...
research
06/07/2023

Enhancing Virtual Assistant Intelligence: Precise Area Targeting for Instance-level User Intents beyond Metadata

Virtual assistants have been widely used by mobile phone users in recent...

Please sign up or login with your details

Forgot password? Click here to reset