Three-dimensional multimodal medical imaging system based on free-hand ultrasound and structured light

05/29/2021
by   Jhacson Meza, et al.
0

We propose a three-dimensional (3D) multimodal medical imaging system that combines freehand ultrasound and structured light 3D reconstruction in a single coordinate system without requiring registration. To the best of our knowledge, these techniques have not been combined before as a multimodal imaging technique. The system complements the internal 3D information acquired with ultrasound, with the external surface measured with the structure light technique. Moreover, the ultrasound probe's optical tracking for pose estimation was implemented based on a convolutional neural network. Experimental results show the system's high accuracy and reproducibility, as well as its potential for preoperative and intraoperative applications. The experimental multimodal error, or the distance from two surfaces obtained with different modalities, was 0.12 mm. The code is available as a Github repository.

READ FULL TEXT

page 5

page 6

page 7

page 11

page 12

research
11/18/2021

Neural Network Kalman filtering for 3D object tracking from linear array ultrasound data

Many interventional surgical procedures rely on medical imaging to visua...
research
09/17/2016

A Deep Metric for Multimodal Registration

Multimodal registration is a challenging problem in medical imaging due ...
research
07/13/2020

Robotized Ultrasound Imaging of the Peripheral Arteries – a Phantom Study

The first choice in diagnostic imaging for patients suffering from perip...
research
11/20/2019

The dynamics of the stomatognathic system from 4D multimodal data

The purpose of this chapter is to discuss methods of acquisition, visual...
research
08/28/2023

Medical needle tip tracking based on Optical Imaging and AI

Deep needle insertion to a target often poses a huge challenge, requirin...
research
11/10/2020

Tattoo tomography: Freehand 3D photoacoustic image reconstruction with an optical pattern

Purpose: Photoacoustic tomography (PAT) is a novel imaging technique tha...
research
03/10/2021

Oversampling errors in multimodal medical imaging are due to the Gibbs effect

To analyse multimodal 3-dimensional medical images, interpolation is req...

Please sign up or login with your details

Forgot password? Click here to reset