Real-time Nonrigid Mosaicking of Laparoscopy Images

03/12/2021
by   Haoyin Zhou, et al.
2

The ability to extend the field of view of laparoscopy images can help the surgeons to obtain a better understanding of the anatomical context. However, due to tissue deformation, complex camera motion and significant three-dimensional (3D) anatomical surface, image pixels may have non-rigid deformation and traditional mosaicking methods cannot work robustly for laparoscopy images in real-time. To solve this problem, a novel two-dimensional (2D) non-rigid simultaneous localization and mapping (SLAM) system is proposed in this paper, which is able to compensate for the deformation of pixels and perform image mosaicking in real-time. The key algorithm of this 2D non-rigid SLAM system is the expectation maximization and dual quaternion (EMDQ) algorithm, which can generate smooth and dense deformation field from sparse and noisy image feature matches in real-time. An uncertainty-based loop closing method has been proposed to reduce the accumulative errors. To achieve real-time performance, both CPU and GPU parallel computation technologies are used for dense mosaicking of all pixels. Experimental results on in vivo and synthetic data demonstrate the feasibility and accuracy of our non-rigid mosaicking method.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 9

page 10

research
07/16/2020

Smooth Deformation Field-based Mismatch Removal in Real-time

This paper studies the mismatch removal problem, which may serve as the ...
research
07/16/2020

Real-time Surface Deformation Recovery from Stereo Videos

Tissue deformation during the surgery may significantly decrease the acc...
research
06/20/2019

An observable time series based SLAM algorithm for deforming environment

In this paper, we study the back-end of simultaneous localization and ma...
research
04/11/2023

Scalable Real-Time Vehicle Deformation for Interactive Environments

This paper proposes a real-time physically-based method for simulating v...
research
03/06/2018

MIS-SLAM: Real-time Large Scale Dense Deformable SLAM System in Minimal Invasive Surgery Based on Heterogeneous Computing

Real-time simultaneously localization and dense mapping is very helpful ...
research
04/06/2020

Robust 3D Self-portraits in Seconds

In this paper, we propose an efficient method for robust 3D self-portrai...
research
10/30/2019

Facial Image Deformation Based on Landmark Detection

In this work, we use facial landmarks to make the deformation for facial...

Please sign up or login with your details

Forgot password? Click here to reset