PhysGNN: A Physics-Driven Graph Neural Network Based Model for Predicting Soft Tissue Deformation in Image-Guided Neurosurgery

09/09/2021
by   Yasmin Salehi, et al.
0

Correctly capturing intraoperative brain shift in image-guided neurosurgical procedures is a critical task for aligning preoperative data with intraoperative geometry, ensuring effective surgical navigation and optimal surgical precision. While the finite element method (FEM) is a proven technique to effectively approximate soft tissue deformation through biomechanical formulations, their degree of success boils down to a trade-off between accuracy and speed. To circumvent this problem, the most recent works in this domain have proposed leveraging data-driven models obtained by training various machine learning algorithms, e.g. random forests, artificial neural networks (ANNs), with the results of finite element analysis (FEA) to speed up tissue deformation approximations by prediction. These methods, however, do not account for the structure of the finite element (FE) mesh during training that provides information on node connectivities as well as the distance between them, which can aid with approximating tissue deformation based on the proximity of force load points with the rest of the mesh nodes. Therefore, this work proposes a novel framework, PhysGNN, a data-driven model that approximates the solution of FEA by leveraging graph neural networks (GNNs), which are capable of accounting for the mesh structural information and inductive learning over unstructured grids and complex topological structures. Empirically, we demonstrate that the proposed architecture, PhysGNN, promises accurate and fast soft tissue deformation approximations while remaining computationally feasible, suitable for neurosurgical settings.

READ FULL TEXT
research
03/12/2019

Suite of Meshless Algorithms for Accurate Computation of Soft Tissue Deformation for Surgical Simulation

The ability to predict patient-specific soft tissue deformations is key ...
research
07/05/2022

Data-driven synchronization-avoiding algorithms in the explicit distributed structural analysis of soft tissue

We propose a data-driven framework to increase the computational efficie...
research
03/26/2019

Learning Soft Tissue Behavior of Organs for Surgical Navigation with Convolutional Neural Networks

Purpose: In surgical navigation, pre-operative organ models are presente...
research
12/13/2018

Towards Fast Biomechanical Modeling of Soft Tissue Using Neural Networks

To date, the simulation of organ deformations for applications like ther...
research
03/14/2020

Leveraging Vision and Kinematics Data to Improve Realism of Biomechanic Soft-tissue Simulation for Robotic Surgery

Purpose Surgical simulations play an increasingly important role in surg...
research
08/21/2022

G2Φnet: Relating Genotype and Biomechanical Phenotype of Tissues with Deep Learning

Many genetic mutations adversely affect the structure and function of lo...
research
03/10/2020

A Compact Spectral Descriptor for Shape Deformations

Modern product design in the engineering domain is increasingly driven b...

Please sign up or login with your details

Forgot password? Click here to reset