Deep Learning-based Spatio Temporal Facial Feature Visual Speech Recognition

04/30/2023
by   Pangoth Santhosh Kumar, et al.
0

In low-resource computing contexts, such as smartphones and other tiny devices, Both deep learning and machine learning are being used in a lot of identification systems. as authentication techniques. The transparent, contactless, and non-invasive nature of these face recognition technologies driven by AI has led to their meteoric rise in popularity in recent years. While they are mostly successful, there are still methods to get inside without permission by utilising things like pictures, masks, glasses, etc. In this research, we present an alternate authentication process that makes use of both facial recognition and the individual's distinctive temporal facial feature motions while they speak a password. Because the suggested methodology allows for a password to be specified in any language, it is not limited by language. The suggested model attained an accuracy of 96.1 industry-standard MIRACL-VC1 dataset, demonstrating its efficacy as a reliable and powerful solution. In addition to being data-efficient, the suggested technique shows promising outcomes with as little as 10 positive video examples for training the model. The effectiveness of the network's training is further proved via comparisons with other combined facial recognition and lip reading models.

READ FULL TEXT

page 1

page 2

page 4

page 5

research
12/04/2020

AuthNet: A Deep Learning based Authentication Mechanism using Temporal Facial Feature Movements

Biometric systems based on Machine learning and Deep learning are being ...
research
08/25/2020

Masked Face Recognition for Secure Authentication

With the recent world-wide COVID-19 pandemic, using face masks have beco...
research
04/19/2021

Face-GCN: A Graph Convolutional Network for 3D Dynamic Face Identification/Recognition

Face identification/recognition has significantly advanced over the past...
research
06/19/2021

Neural Network Facial Authentication for Public Electric Vehicle Charging Station

This study is to investigate and compare the facial recognition accuracy...
research
09/20/2023

FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusion

Speech-driven 3D facial animation synthesis has been a challenging task ...
research
07/22/2020

Multi-Spectral Facial Biometrics in Access Control

This study demonstrates how facial biometrics, acquired using multi-spec...
research
12/13/2022

Improving Depression estimation from facial videos with face alignment, training optimization and scheduling

Deep learning models have shown promising results in recognizing depress...

Please sign up or login with your details

Forgot password? Click here to reset