Echocardiography Segmentation Using Neural ODE-based Diffeomorphic Registration Field

06/16/2023
by   Phi Nguyen Van, et al.
0

Convolutional neural networks (CNNs) have recently proven their excellent ability to segment 2D cardiac ultrasound images. However, the majority of attempts to perform full-sequence segmentation of cardiac ultrasound videos either rely on models trained only on keyframe images or fail to maintain the topology over time. To address these issues, in this work, we consider segmentation of ultrasound video as a registration estimation problem and present a novel method for diffeomorphic image registration using neural ordinary differential equations (Neural ODE). In particular, we consider the registration field vector field between frames as a continuous trajectory ODE. The estimated registration field is then applied to the segmentation mask of the first frame to obtain a segment for the whole cardiac cycle. The proposed method, Echo-ODE, introduces several key improvements compared to the previous state-of-the-art. Firstly, by solving a continuous ODE, the proposed method achieves smoother segmentation, preserving the topology of segmentation maps over the whole sequence (Hausdorff distance: 3.7-4.4). Secondly, it maintains temporal consistency between frames without explicitly optimizing for temporal consistency attributes, achieving temporal consistency in 91 the dataset. Lastly, the proposed method is able to maintain the clinical accuracy of the segmentation maps (MAE of the LVEF: 2.7-3.1). The results show that our method surpasses the previous state-of-the-art in multiple aspects, demonstrating the importance of spatial-temporal data processing for the implementation of Neural ODEs in medical imaging applications. These findings open up new research directions for solving echocardiography segmentation tasks.

READ FULL TEXT

page 1

page 4

page 8

page 9

page 10

research
12/03/2021

Echocardiography Segmentation with Enforced Temporal Consistency

Convolutional neural networks (CNN) have demonstrated their ability to s...
research
09/02/2021

A New Semi-Automated Algorithm for Volumetric Segmentation of the Left Ventricle in Temporal 3D Echocardiography Sequences

Purpose: Echocardiography is commonly used as a non-invasive imaging too...
research
04/05/2021

Using spatial-temporal ensembles of convolutional neural networks for lumen segmentation in ureteroscopy

Purpose: Ureteroscopy is an efficient endoscopic minimally invasive tech...
research
07/03/2017

Temporal HeartNet: Towards Human-Level Automatic Analysis of Fetal Cardiac Screening Video

We present an automatic method to describe clinically useful information...
research
04/01/2019

TAN: Temporal Affine Network for Real-Time Left Ventricle Anatomical Structure Analysis Based on 2D Ultrasound Videos

With superiorities on low cost, portability, and free of radiation, echo...
research
06/19/2017

Deep learning with spatiotemporal consistency for nerve segmentation in ultrasound images

Ultrasound-Guided Regional Anesthesia (UGRA) has been gaining importance...
research
05/19/2021

Endless Loops: Detecting and Animating Periodic Patterns in Still Images

We present an algorithm for producing a seamless animated loop from a si...

Please sign up or login with your details

Forgot password? Click here to reset