Deep Learning for Automatic Tracking of Tongue Surface in Real-time Ultrasound Videos, Landmarks instead of Contours

03/16/2020
by   M. Hamed Mozaffari, et al.
0

One usage of medical ultrasound imaging is to visualize and characterize human tongue shape and motion during a real-time speech to study healthy or impaired speech production. Due to the low-contrast characteristic and noisy nature of ultrasound images, it might require expertise for non-expert users to recognize tongue gestures in applications such as visual training of a second language. Moreover, quantitative analysis of tongue motion needs the tongue dorsum contour to be extracted, tracked, and visualized. Manual tongue contour extraction is a cumbersome, subjective, and error-prone task. Furthermore, it is not a feasible solution for real-time applications. The growth of deep learning has been vigorously exploited in various computer vision tasks, including ultrasound tongue contour tracking. In the current methods, the process of tongue contour extraction comprises two steps of image segmentation and post-processing. This paper presents a new novel approach of automatic and real-time tongue contour tracking using deep neural networks. In the proposed method, instead of the two-step procedure, landmarks of the tongue surface are tracked. This novel idea enables researchers in this filed to benefits from available previously annotated databases to achieve high accuracy results. Our experiment disclosed the outstanding performances of the proposed technique in terms of generalization, performance, and accuracy.

READ FULL TEXT

page 4

page 5

page 6

research
06/10/2019

BowNet: Dilated Convolution Neural Network for Ultrasound Tongue Contour Extraction

Ultrasound imaging is safe, relatively affordable, and capable of real-t...
research
11/10/2019

IrisNet: Deep Learning for Automatic and Real-time Tongue Contour Tracking in Ultrasound Video Data using Peripheral Vision

The progress of deep convolutional neural networks has been successfully...
research
06/10/2019

Transfer Learning for Ultrasound Tongue Contour Extraction with Different Domains

Medical ultrasound technology is widely used in routine clinical applica...
research
07/24/2019

A CNN-based tool for automatic tongue contour tracking in ultrasound images

For speech research, ultrasound tongue imaging provides a non-invasive m...
research
11/22/2019

Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

Despite renewed awareness of the importance of articulation, it remains ...
research
03/19/2018

Adaptive Polar Active Contour for Segmentation and Tracking in Ultrasound Videos

Detection of relative changes in circulating blood volume is important t...
research
08/07/2023

Automated Real Time Delineation of Supraclavicular Brachial Plexus in Neck Ultrasonography Videos: A Deep Learning Approach

Peripheral nerve blocks are crucial to treatment of post-surgical pain a...

Please sign up or login with your details

Forgot password? Click here to reset