A multi-task learning framework for carotid plaque segmentation and classification from ultrasound images

07/02/2023
by   Haitao Gan, et al.
0

Carotid plaque segmentation and classification play important roles in the treatment of atherosclerosis and assessment for risk of stroke. Although deep learning methods have been used for carotid plaque segmentation and classification, most focused on a single task and ignored the relationship between the segmentation and classification of carotid plaques. Therefore, we propose a multi-task learning framework for ultrasound carotid plaque segmentation and classification, which utilizes a region-weight module (RWM) and a sample-weight module (SWM) to exploit the correlation between these two tasks. The RWM provides a plaque regional prior knowledge to the classification task, while the SWM is designed to learn the categorical sample weight for the segmentation task. A total of 1270 2D ultrasound images of carotid plaques were collected from Zhongnan Hospital (Wuhan, China) for our experiments. The results of the experiments showed that the proposed method can significantly improve the performance compared to existing networks trained for a single task, with an accuracy of 85.82 coefficient of 84.92 demonstrated that both the designed RWM and SWM were beneficial in improving the network's performance. Therefore, we believe that the proposed method could be useful for carotid plaque analysis in clinical trials and practice.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
05/25/2018

Less is More: Simultaneous View Classification and Landmark Detection for Abdominal Ultrasound Images

An abdominal ultrasound examination, which is the most common ultrasound...
research
05/15/2018

Cross-connected Networks for Multi-task Learning of Detection and Segmentation

Multi-task learning improves generalization performance by sharing knowl...
research
07/14/2021

FetalNet: Multi-task deep learning framework for fetal ultrasound biometric measurements

In this paper, we propose an end-to-end multi-task neural network called...
research
08/21/2019

Representation Disentanglement for Multi-task Learning with application to Fetal Ultrasound

One of the biggest challenges for deep learning algorithms in medical im...
research
10/29/2021

Multi-Task and Multi-Modal Learning for RGB Dynamic Gesture Recognition

Gesture recognition is getting more and more popular due to various appl...
research
12/27/2022

From Single-Visit to Multi-Visit Image-Based Models: Single-Visit Models are Enough to Predict Obstructive Hydronephrosis

Previous work has shown the potential of deep learning to predict renal ...
research
12/18/2019

Learning to Segment Brain Anatomy from 2D Ultrasound with Less Data

Automatic segmentation of anatomical landmarks from ultrasound (US) play...

Please sign up or login with your details

Forgot password? Click here to reset