Language identification as improvement for lip-based biometric visual systems

02/27/2023
by   Lucia Cascone, et al.
0

Language has always been one of humanity's defining characteristics. Visual Language Identification (VLI) is a relatively new field of research that is complex and largely understudied. In this paper, we present a preliminary study in which we use linguistic information as a soft biometric trait to enhance the performance of a visual (auditory-free) identification system based on lip movement. We report a significant improvement in the identification performance of the proposed visual system as a result of the integration of these data using a score-based fusion strategy. Methods of Deep and Machine Learning are considered and evaluated. To the experimentation purposes, the dataset called laBial Articulation for the proBlem of the spokEn Language rEcognition (BABELE), consisting of eight different languages, has been created. It includes a collection of different features of which the spoken language represents the most relevant, while each sample is also manually labelled with gender and age of the subjects.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/30/2020

Language Identification of Devanagari Poems

Language Identification is a very important part of several text process...
research
10/22/2020

Rediscovering the Slavic Continuum in Representations Emerging from Neural Models of Spoken Language Identification

Deep neural networks have been employed for various spoken language reco...
research
11/12/2017

Gender recognition and biometric identification using a large dataset of hand images

The human hand possesses distinctive features which can reveal gender in...
research
09/09/2021

Multilingual Audio-Visual Smartphone Dataset And Evaluation

Smartphones have been employed with biometric-based verification systems...
research
09/19/2023

Multimodal Modeling For Spoken Language Identification

Spoken language identification refers to the task of automatically predi...
research
04/08/2022

Transducer-based language embedding for spoken language identification

The acoustic and linguistic features are important cues for the spoken l...
research
07/22/2020

Dog Identification using Soft Biometrics and Neural Networks

This paper addresses the problem of biometric identification of animals,...

Please sign up or login with your details

Forgot password? Click here to reset