DeepAI AI Chat
Log In Sign Up

4D Spatio-Temporal Convolutional Networks for Object Position Estimation in OCT Volumes

by   Marcel Bengs, et al.

Tracking and localizing objects is a central problem in computer-assisted surgery. Optical coherence tomography (OCT) can be employed as an optical tracking system, due to its high spatial and temporal resolution. Recently, 3D convolutional neural networks (CNNs) have shown promising performance for pose estimation of a marker object using single volumetric OCT images. While this approach relied on spatial information only, OCT allows for a temporal stream of OCT image volumes capturing the motion of an object at high volumes rates. In this work, we systematically extend 3D CNNs to 4D spatio-temporal CNNs to evaluate the impact of additional temporal information for marker object tracking. Across various architectures, our results demonstrate that using a stream of OCT volumes and employing 4D spatio-temporal convolutions leads to a 30 CNNs.


A Deep Learning Approach for Motion Forecasting Using 4D OCT Data

Forecasting motion of a specific target object is a common problem for s...

Two-stream convolutional networks for end-to-end learning of self-driving cars

We propose a methodology to extend the concept of Two-Stream Convolution...

Deep learning with 4D spatio-temporal data representations for OCT-based force estimation

Estimating the forces acting between instruments and tissue is a challen...

Spatio-Temporal Deep Learning Methods for Motion Estimation Using 4D OCT Image Data

Purpose. Localizing structures and estimating the motion of a specific t...

A Deep Learning Approach for Pose Estimation from Volumetric OCT Data

Tracking the pose of instruments is a central problem in image-guided su...

Spatio-Temporal Dual-Stream Neural Network for Sequential Whole-Body PET Segmentation

Sequential whole-body 18F-Fluorodeoxyglucose (FDG) positron emission tom...

Preterm Infants’ Pose Estimation With Spatio-Temporal Features

Objective: Preterm infants’ limb monitoring in neonatal intensive care u...