Progress in animation of an EMA-controlled tongue model for acoustic-visual speech synthesis

01/19/2012
by   Ingmar Steiner, et al.
0

We present a technique for the animation of a 3D kinematic tongue model, one component of the talking head of an acoustic-visual (AV) speech synthesizer. The skeletal animation approach is adapted to make use of a deformable rig controlled by tongue motion capture data obtained with electromagnetic articulography (EMA), while the tongue surface is extracted from volumetric magnetic resonance imaging (MRI) data. Initial results are shown and future work outlined.

READ FULL TEXT

page 3

page 4

research
03/17/2017

Numerical Simulation of Bloch Equations for Dynamic Magnetic Resonance Imaging

Magnetic Resonance Imaging (MRI) is a widely applied non-invasive imagin...
research
12/15/2016

A Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract

We present a multilinear statistical model of the human tongue that capt...
research
08/30/2022

A Study on the relationship between the geometrical shapes and the biometrical acoustic characteristics of human ear canal

Ear acoustic authentication is a new biometrics method and it utilizes t...
research
05/15/2019

Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models

Speech-driven visual speech synthesis involves mapping features extracte...
research
10/05/2020

Characterization of surface motion patterns in highly deformable soft tissue organs from dynamic Magnetic Resonance Imaging

In this work, we present a pipeline for characterization of bladder surf...
research
06/21/2021

PIANO: A Parametric Hand Bone Model from Magnetic Resonance Imaging

Hand modeling is critical for immersive VR/AR, action understanding, or ...
research
01/17/2023

MRI-powered Magnetic Miniature Capsule Robot with HIFU-controlled On-demand Drug Delivery

Magnetic resonance imaging (MRI)-guided robotic systems offer great pote...

Please sign up or login with your details

Forgot password? Click here to reset