DeepAI AI Chat
Log In Sign Up

End-to-End Real-time Catheter Segmentation with Optical Flow-Guided Warping during Endovascular Intervention

by   Anh Nguyen, et al.
Imperial College London

Accurate real-time catheter segmentation is an important pre-requisite for robot-assisted endovascular intervention. Most of the existing learning-based methods for catheter segmentation and tracking are only trained on small-scale datasets or synthetic data due to the difficulties of ground-truth annotation. Furthermore, the temporal continuity in intraoperative imaging sequences is not fully utilised. In this paper, we present FW-Net, an end-to-end and real-time deep learning framework for endovascular intervention. The proposed FW-Net has three modules: a segmentation network with encoder-decoder architecture, a flow network to extract optical flow information, and a novel flow-guided warping function to learn the frame-to-frame temporal continuity. We show that by effectively learning temporal continuity, the network can successfully segment and track the catheters in real-time sequences using only raw ground-truth for training. Detailed validation results confirm that our FW-Net outperforms state-of-the-art techniques while achieving real-time performance.


page 1

page 3

page 6


Unsupervised Generation of Optical Flow Datasets from Videos in the Wild

Dense optical flow ground truth of non-rigid motion for real-world image...

Deep Segmentation and Registration in X-Ray Angiography Video

In interventional radiology, short video sequences of vein structure in ...

Guided Optical Flow Learning

We study the unsupervised learning of CNNs for optical flow estimation u...

Optical flow-based vascular respiratory motion compensation

This paper develops a new vascular respiratory motion compensation algor...

Temporal Interpolation as an Unsupervised Pretraining Task for Optical Flow Estimation

The difficulty of annotating training data is a major obstacle to using ...

KORSAL: Key-point Detection based Online Real-Time Spatio-Temporal Action Localization

Real-time and online action localization in a video is a critical yet hi...

NanoFlowNet: Real-time Dense Optical Flow on a Nano Quadcopter

Nano quadcopters are small, agile, and cheap platforms that are well sui...