TopNet: Topology Preserving Metric Learning for Vessel Tree Reconstruction and Labelling

09/18/2020
by   Deepak Keshwani, et al.
5

Reconstructing Portal Vein and Hepatic Vein trees from contrast enhanced abdominal CT scans is a prerequisite for preoperative liver surgery simulation. Existing deep learning based methods treat vascular tree reconstruction as a semantic segmentation problem. However, vessels such as hepatic and portal vein look very similar locally and need to be traced to their source for robust label assignment. Therefore, semantic segmentation by looking at local 3D patch results in noisy misclassifications. To tackle this, we propose a novel multi-task deep learning architecture for vessel tree reconstruction. The network architecture simultaneously solves the task of detecting voxels on vascular centerlines (i.e. nodes) and estimates connectivity between center-voxels (edges) in the tree structure to be reconstructed. Further, we propose a novel connectivity metric which considers both inter-class distance and intra-class topological distance between center-voxel pairs. Vascular trees are reconstructed starting from the vessel source using the learned connectivity metric using the shortest path tree algorithm. A thorough evaluation on public IRCAD dataset shows that the proposed method considerably outperforms existing semantic segmentation based methods. To the best of our knowledge, this is the first deep learning based approach which learns multi-label tree structure connectivity from images.

READ FULL TEXT

page 2

page 4

page 7

page 8

page 11

page 12

research
07/16/2019

AirwayNet: A Voxel-Connectivity Aware Approach for Accurate Airway Segmentation Using Convolutional Neural Networks

Airway segmentation on CT scans is critical for pulmonary disease diagno...
research
01/25/2017

Learning Multi-level Region Consistency with Dense Multi-label Networks for Semantic Segmentation

Semantic image segmentation is a fundamental task in image understanding...
research
05/01/2020

Deeply Cascaded U-Net for Multi-Task Image Processing

In current practice, many image processing tasks are done sequentially (...
research
04/25/2018

Learning a Discriminative Feature Network for Semantic Segmentation

Most existing methods of semantic segmentation still suffer from two asp...
research
12/21/2019

A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D images

Semantic segmentation is the pixel-wise labelling of an image. Since the...
research
06/13/2018

Tree Edit Distance Learning via Adaptive Symbol Embeddings

Metric learning has the aim to improve classification accuracy by learni...
research
01/10/2022

Swin transformers make strong contextual encoders for VHR image road extraction

Significant progress has been made in automatic road extra-ction or segm...

Please sign up or login with your details

Forgot password? Click here to reset