Multilingual Audio-Visual Smartphone Dataset And Evaluation

09/09/2021
by   Hareesh Mandalapu, et al.
0

Smartphones have been employed with biometric-based verification systems to provide security in highly sensitive applications. Audio-visual biometrics are getting popular due to the usability and also it will be challenging to spoof because of multi-modal nature. In this work, we present an audio-visual smartphone dataset captured in five different recent smartphones. This new dataset contains 103 subjects captured in three different sessions considering the different real-world scenarios. Three different languages are acquired in this dataset to include the problem of language dependency of the speaker recognition systems. These unique characteristics of this dataset will pave the way to implement novel state-of-the-art unimodal or audio-visual speaker recognition systems. We also report the performance of the bench-marked biometric verification systems on our dataset. The robustness of biometric algorithms is evaluated towards multiple dependencies like signal noise, device, language and presentation attacks like replay and synthesized signals with extensive experiments. The obtained results raised many concerns about the generalization properties of state-of-the-art biometrics methods in smartphones.

READ FULL TEXT

page 5

page 9

page 10

page 11

page 12

page 16

page 17

page 19

research
12/05/2019

Smartphone Multi-modal Biometric Authentication: Database and Evaluation

Biometric-based verification is widely employed on the smartphones for v...
research
01/24/2021

Audio-Visual Biometric Recognition and Presentation Attack Detection: A Comprehensive Survey

Biometric recognition is a trending technology that uses unique characte...
research
04/28/2020

Cross-modal Speaker Verification and Recognition: A Multilingual Perspective

Recent years have seen a surge in finding association between faces and ...
research
03/30/2020

Towards Palmprint Verification On Smartphones

With the rapid development of mobile devices, smartphones have gradually...
research
02/06/2014

Multispectral Palmprint Encoding and Recognition

Palmprints are emerging as a new entity in multi-modal biometrics for hu...
research
12/09/2022

Finger-NestNet: Interpretable Fingerphoto Verification on Smartphone using Deep Nested Residual Network

Fingerphoto images captured using a smartphone are successfully used to ...
research
02/27/2023

Language identification as improvement for lip-based biometric visual systems

Language has always been one of humanity's defining characteristics. Vis...

Please sign up or login with your details

Forgot password? Click here to reset