Log In Sign Up

Physics Driven Domain Specific Transporter Framework with Attention Mechanism for Ultrasound Imaging

by   Arpan Tripathi, et al.

Most applications of deep learning techniques in medical imaging are supervised and require a large number of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, physics driven domain specific transporter framework with an attention mechanism to identify relevant key points with applications in ultrasound imaging. The proposed framework identifies key points that provide a concise geometric representation highlighting regions with high structural variation in ultrasound videos. We incorporate physics driven domain specific information as a feature probability map and use the radon transform to highlight features in specific orientations. The proposed framework has been trained on130 Lung ultrasound (LUS) videos and 113 Wrist ultrasound (WUS) videos and validated on 100 Lung ultrasound (LUS) videos and 58 Wrist ultrasound (WUS) videos acquired from multiple centers across the globe. Images from both datasets were independently assessed by experts to identify clinically relevant features such as A-lines, B-lines and pleura from LUS and radial metaphysis, radial epiphysis and carpal bones from WUS videos. The key points detected from both datasets showed high sensitivity (LUS = 99% , WUS = 74%) in detecting the image landmarks identified by experts. Also, on employing for classification of the given lung image into normal and abnormal classes, the proposed approach, even with no prior training, achieved an average accuracy of 97% and an average F1-score of 95% respectively on the task of co-classification with 3 fold cross-validation. With the purely unsupervised nature of the proposed approach, we expect the key point detection approach to increase the applicability of ultrasound in various examination performed in emergency and point of care.


page 1

page 3

page 4

page 6

page 7

page 9

page 14

page 15


Domain Specific Transporter Framework to Detect Fractures in Ultrasound

Ultrasound examination for detecting fractures is ideally suited for Eme...

Learning the Imaging Landmarks: Unsupervised Key point Detection in Lung Ultrasound Videos

Lung ultrasound (LUS) is an increasingly popular diagnostic imaging moda...

Unsupervised multi-latent space reinforcement learning framework for video summarization in ultrasound imaging

The COVID-19 pandemic has highlighted the need for a tool to speed up tr...

B-line Detection in Lung Ultrasound Videos: Cartesian vs Polar Representation

Lung ultrasound (LUS) imaging is becoming popular in the intensive care ...

Deep learning in the ultrasound evaluation of neonatal respiratory status

Lung ultrasound imaging is reaching growing interest from the scientific...

Automatic Detection of B-lines in Lung Ultrasound Videos From Severe Dengue Patients

Lung ultrasound (LUS) imaging is used to assess lung abnormalities, incl...

Accelerating Detection of Lung Pathologies with Explainable Ultrasound Image Analysis

Care during the COVID-19 pandemic hinges upon the existence of fast, saf...

Code Repositories


Evaluation repository of Unsupervised Keypoint Detection models trained on Lung and Wrist Ultrasound videos

view repo