Bioresorbable Scaffold Visualization in IVOCT Images Using CNNs and Weakly Supervised Localization

10/22/2018
by   Nils Gessert, et al.
4

Bioresorbable scaffolds have become a popular choice for treatment of coronary heart disease, replacing traditional metal stents. Often, intravascular optical coherence tomography is used to assess potential malapposition after implantation and for follow-up examinations later on. Typically, the scaffold is manually reviewed by an expert, analyzing each of the hundreds of image slices. As this is time consuming, automatic stent detection and visualization approaches have been proposed, mostly for metal stent detection based on classic image processing. As bioresorbable scaffolds are harder to detect, recent approaches have used feature extraction and machine learning methods for automatic detection. However, these methods require detailed, pixel-level labels in each image slice and extensive feature engineering for the particular stent type which might limit the approaches' generalization capabilities. Therefore, we propose a deep learning-based method for bioresorbable scaffold visualization using only image-level labels. A convolutional neural network is trained to predict whether an image slice contains a metal stent, a bioresorbable scaffold, or no device. Then, we derive local stent strut information by employing weakly supervised localization using saliency maps with guided backpropagation. As saliency maps are generally diffuse and noisy, we propose a novel patch-based method with image shifting which allows for high resolution stent visualization. Our convolutional neural network model achieves a classification accuracy of 99.0 stent classification which can be used for both high quality in-slice stent visualization and 3D rendering of the stent structure.

READ FULL TEXT

page 3

page 4

page 5

page 6

research
07/10/2018

Convolutional neural network based automatic plaque characterization from intracoronary optical coherence tomography images

Optical coherence tomography (OCT) can provide high-resolution cross-sec...
research
05/03/2021

Weakly supervised deep learning-based intracranial hemorrhage localization

Intracranial hemorrhage is a life-threatening disease, which requires fa...
research
10/16/2018

Generating Self-Guided Dense Annotations for Weakly Supervised Semantic Segmentation

Learning semantic segmentation models under image-level supervision is f...
research
09/03/2023

Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning

As advanced image manipulation techniques emerge, detecting the manipula...
research
11/06/2020

A Weakly Supervised Convolutional Network for Change Segmentation and Classification

Fully supervised change detection methods require difficult to procure p...
research
06/07/2016

Learning deep structured network for weakly supervised change detection

Conventional change detection methods require a large number of images t...
research
08/05/2019

A Weakly-Supervised Attention-based Visualization Tool for Assessing Political Affiliation

In this work, we seek to finetune a weakly-supervised expert-guided Deep...

Please sign up or login with your details

Forgot password? Click here to reset