Artimate: an articulatory animation framework for audiovisual speech synthesis

03/15/2012
by   Ingmar Steiner, et al.
0

We present a modular framework for articulatory animation synthesis using speech motion capture data obtained with electromagnetic articulography (EMA). Adapting a skeletal animation approach, the articulatory motion data is applied to a three-dimensional (3D) model of the vocal tract, creating a portable resource that can be integrated in an audiovisual (AV) speech synthesis platform to provide realistic animation of the tongue and teeth for a virtual character. The framework also provides an interface to articulatory animation synthesis, as well as an example application to illustrate its use with a 3D game engine. We rely on cross-platform, open-source software and open standards to provide a lightweight, accessible, and portable workflow.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 3

page 4

12/13/2017

Creating New Language and Voice Components for the Updated MaryTTS Text-to-Speech Synthesis Platform

We present a new workflow to create components for the MaryTTS text-to-s...
09/22/2012

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

The importance of modeling speech articulation for high-quality audiovis...
02/02/2021

SPEAK WITH YOUR HANDS Using Continuous Hand Gestures to control Articulatory Speech Synthesizer

This work presents our advancements in controlling an articulatory speec...
10/06/2020

Neural Speech Synthesis for Estonian

This technical report describes the results of a collaboration between t...
12/05/2019

Generative Synthesis of Insurance Datasets

One of the impediments in advancing actuarial research and developing op...
03/02/2021

DeepFake-o-meter: An Open Platform for DeepFake Detection

In recent years, the advent of deep learning-based techniques and the si...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.