Comparing heterogeneous visual gestures for measuring the diversity of visual speech signals

05/08/2018
by   Helen L Bear, et al.
0

Visual lip gestures observed whilst lipreading have a few working definitions, the most common two are; `the visual equivalent of a phoneme' and `phonemes which are indistinguishable on the lips'. To date there is no formal definition, in part because to date we have not established a two-way relationship or mapping between visemes and phonemes. Some evidence suggests that visual speech is highly dependent upon the speaker. So here, we use a phoneme-clustering method to form new phoneme-to-viseme maps for both individual and multiple speakers. We test these phoneme to viseme maps to examine how similarly speakers talk visually and we use signed rank tests to measure the distance between individuals. We conclude that broadly speaking, speakers have the same repertoire of mouth gestures, where they differ is in the use of the gestures.

READ FULL TEXT

page 6

page 7

research
10/03/2017

Speaker-independent machine lip-reading with speaker-dependent viseme classifiers

In machine lip-reading, which is identification of speech from visual-on...
research
10/03/2017

Decoding visemes: improving machine lipreading (PhD thesis)

Machine lipreading (MLR) is speech recognition from visual cues and a ni...
research
03/31/2022

Speaker Extraction with Co-Speech Gestures Cue

Speaker extraction seeks to extract the clean speech of a target speaker...
research
12/09/2018

Speech-Gesture Mapping and Engagement Evaluation in Human Robot Interaction

A robot needs contextual awareness, effective speech production and comp...
research
12/15/2021

Speech frame implementation for speech analysis and recognition

Distinctive features of the created speech frame are: the ability to tak...
research
07/01/2021

Passing a Non-verbal Turing Test: Evaluating Gesture Animations Generated from Speech

In real life, people communicate using both speech and non-verbal signal...
research
07/24/2018

Speakers account for asymmetries in visual perspective so listeners don't have to

Debates over adults' theory of mind use have been fueled by surprising f...

Please sign up or login with your details

Forgot password? Click here to reset