A Deep Learning Approach for Motion Forecasting Using 4D OCT Data

04/21/2020
by   Marcel Bengs, et al.
0

Forecasting motion of a specific target object is a common problem for surgical interventions, e.g. for localization of a target region, guidance for surgical interventions, or motion compensation. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution. Recently, deep learning methods have shown promising performance for OCT-based motion estimation based on two volumetric images. We extend this approach and investigate whether using a time series of volumes enables motion forecasting. We propose 4D spatio-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. We design and evaluate five different 3D and 4D deep learning methods using a tissue data set. Our best performing 4D method achieves motion forecasting with an overall average correlation coefficient of 97.41 performance by a factor of 2.5 compared to a previous 3D approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2020

Spatio-Temporal Deep Learning Methods for Motion Estimation Using 4D OCT Image Data

Purpose. Localizing structures and estimating the motion of a specific t...
research
07/02/2020

4D Spatio-Temporal Convolutional Networks for Object Position Estimation in OCT Volumes

Tracking and localizing objects is a central problem in computer-assiste...
research
10/22/2018

Two-path 3D CNNs for calibration of system parameters for OCT-based motion compensation

Automatic motion compensation and adjustment of an intraoperative imagin...
research
05/20/2020

Deep learning with 4D spatio-temporal data representations for OCT-based force estimation

Estimating the forces acting between instruments and tissue is a challen...
research
04/26/2018

Force Estimation from OCT Volumes using 3D CNNs

Purpose Estimating the interaction forces of instruments and tissue is o...
research
06/13/2018

Higher Order of Motion Magnification for Vessel Localisation in Surgical Video

Locating vessels during surgery is critical for avoiding inadvertent dam...
research
09/30/2021

Deep Homography Estimation in Dynamic Surgical Scenes for Laparoscopic Camera Motion Extraction

Current laparoscopic camera motion automation relies on rule-based appro...

Please sign up or login with your details

Forgot password? Click here to reset