Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

11/22/2019
by   M. Hamed Mozaffari, et al.
11

Despite renewed awareness of the importance of articulation, it remains a challenge for instructors to handle the pronunciation needs of language learners. There are relatively scarce pedagogical tools for pronunciation teaching and learning. Unlike inefficient, traditional pronunciation instructions like listening and repeating, electronic visual feedback (EVF) systems such as ultrasound technology have been employed in new approaches. Recently, an ultrasound-enhanced multimodal method has been developed for visualizing tongue movements of a language learner overlaid on the face-side of the speaker's head. That system was evaluated for several language courses via a blended learning paradigm at the university level. The result was asserted that visualizing the articulator's system as biofeedback to language learners will significantly improve articulation learning efficiency. In spite of the successful usage of multimodal techniques for pronunciation training, it still requires manual works and human manipulation. In this article, we aim to contribute to this growing body of research by addressing difficulties of the previous approaches by proposing a new comprehensive, automatic, real-time multimodal pronunciation training system, benefits from powerful artificial intelligence techniques. The main objective of this research was to combine the advantages of ultrasound technology, three-dimensional printing, and deep learning algorithms to enhance the performance of previous systems. Our preliminary pedagogical evaluation of the proposed system revealed a significant improvement in flexibility, control, robustness, and autonomy.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

page 9

page 10

research
11/10/2019

IrisNet: Deep Learning for Automatic and Real-time Tongue Contour Tracking in Ultrasound Video Data using Peripheral Vision

The progress of deep convolutional neural networks has been successfully...
research
03/16/2020

Deep Learning for Automatic Tracking of Tongue Surface in Real-time Ultrasound Videos, Landmarks instead of Contours

One usage of medical ultrasound imaging is to visualize and characterize...
research
08/07/2019

Confident Head Circumference Measurement from Ultrasound with Real-time Feedback for Sonographers

Manual estimation of fetal Head Circumference (HC) from Ultrasound (US) ...
research
07/21/2022

Towards Confident Detection of Prostate Cancer using High Resolution Micro-ultrasound

MOTIVATION: Detection of prostate cancer during transrectal ultrasound-g...
research
01/22/2021

A Universal Deep Learning Framework for Real-Time Denoising of Ultrasound Images

Ultrasound images are widespread in medical diagnosis for muscle-skeleta...
research
10/20/2019

Deep Mouse: An End-to-end Auto-context Refinement Framework for Brain Ventricle and Body Segmentation in Embryonic Mice Ultrasound Volumes

High-frequency ultrasound (HFU) is well suited for imaging embryonic mic...

Please sign up or login with your details

Forgot password? Click here to reset