4D Spatio-Temporal Convolutional Networks for Object Position Estimation in OCT Volumes

07/02/2020
by   Marcel Bengs, et al.
0

Tracking and localizing objects is a central problem in computer-assisted surgery. Optical coherence tomography (OCT) can be employed as an optical tracking system, due to its high spatial and temporal resolution. Recently, 3D convolutional neural networks (CNNs) have shown promising performance for pose estimation of a marker object using single volumetric OCT images. While this approach relied on spatial information only, OCT allows for a temporal stream of OCT image volumes capturing the motion of an object at high volumes rates. In this work, we systematically extend 3D CNNs to 4D spatio-temporal CNNs to evaluate the impact of additional temporal information for marker object tracking. Across various architectures, our results demonstrate that using a stream of OCT volumes and employing 4D spatio-temporal convolutions leads to a 30 CNNs.

READ FULL TEXT
research
04/21/2020

A Deep Learning Approach for Motion Forecasting Using 4D OCT Data

Forecasting motion of a specific target object is a common problem for s...
research
11/13/2018

Two-stream convolutional networks for end-to-end learning of self-driving cars

We propose a methodology to extend the concept of Two-Stream Convolution...
research
05/20/2020

Deep learning with 4D spatio-temporal data representations for OCT-based force estimation

Estimating the forces acting between instruments and tissue is a challen...
research
04/21/2020

Spatio-Temporal Deep Learning Methods for Motion Estimation Using 4D OCT Image Data

Purpose. Localizing structures and estimating the motion of a specific t...
research
03/10/2018

A Deep Learning Approach for Pose Estimation from Volumetric OCT Data

Tracking the pose of instruments is a central problem in image-guided su...
research
06/09/2021

Spatio-Temporal Dual-Stream Neural Network for Sequential Whole-Body PET Segmentation

Sequential whole-body 18F-Fluorodeoxyglucose (FDG) positron emission tom...
research
08/14/2020

Preterm Infants’ Pose Estimation With Spatio-Temporal Features

Objective: Preterm infants’ limb monitoring in neonatal intensive care u...

Please sign up or login with your details

Forgot password? Click here to reset