Automatic vocal tract landmark localization from midsagittal MRI data

07/18/2019
by   Mohammad Eslami, et al.
0

The various speech sounds of a language are obtained by varying the shape and position of the articulators surrounding the vocal tract. Analyzing their variability is crucial for understanding speech production, diagnosing speech and swallowing disorders and building intuitive applications for rehabilitation. Magnetic Resonance Imaging (MRI) is currently the most harmless powerful imaging modality used for this purpose. Identifying key anatomical landmarks on it is a pre-requisite for further analyses. This is a challenging task considering the high inter- and intra-speaker variability and the mutual interaction between the articulators. This study intends to solve this issue automatically for the first time. For this purpose, midsagittal anatomical MRI for 9 speakers sustaining 62 articulations and annotated with the location of 21 key anatomical landmarks are considered. Four state-of-the-art methods, including deep learning methods, are adapted from the literature for facial landmark localization and human pose estimation and evaluated. Furthermore, an approach based on the description of each landmark location as a heat-map image stored in a channel of a single multi-channel image embedding all landmarks is proposed. The generation of such a multi-channel image from an input MRI image is tested through two deep learning networks, one taken from the literature and one designed on purpose in this study, the flat-net. Results show that the flat-net approach outperforms the other methods, leading to an overall Root Mean Square Error of 3.4 pixels/0.34 cm obtained in a leave-one-out procedure over the speakers. All of the codes are publicly available on GitHub.

READ FULL TEXT

page 1

page 2

page 4

page 8

page 9

research
07/26/2023

Towards multi-modal anatomical landmark detection for ultrasound-guided brain tumor resection with contrastive learning

Homologous anatomical landmarks between medical scans are instrumental i...
research
05/18/2023

Enhancing Speech Articulation Analysis using a Geometric Transformation of the X-ray Microbeam Dataset

Accurate analysis of speech articulation is crucial for speech analysis....
research
12/15/2016

A Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract

We present a multilinear statistical model of the human tongue that capt...
research
03/31/2023

Live image-based neurosurgical guidance and roadmap generation using unsupervised embedding

Advanced minimally invasive neurosurgery navigation relies mainly on Mag...
research
10/14/2019

Multi-view consensus CNN for 3D facial landmark placement

The rapid increase in the availability of accurate 3D scanning devices h...
research
10/22/2021

Feasibility of Remote Landmark Identification for Cricothyrotomy Using Robotic Palpation

Cricothyrotomy is a life-saving emergency intervention that secures an a...
research
06/30/2019

Multiple Landmark Detection using Multi-Agent Reinforcement Learning

The detection of anatomical landmarks is a vital step for medical image ...

Please sign up or login with your details

Forgot password? Click here to reset