DeepAI AI Chat
Log In Sign Up

TransforMesh: A Transformer Network for Longitudinal modeling of Anatomical Meshes

by   Ignacio Sarasua, et al.

The longitudinal modeling of neuroanatomical changes related to Alzheimer's disease (AD) is crucial for studying the progression of the disease. To this end, we introduce TransforMesh, a spatio-temporal network based on transformers that models longitudinal shape changes on 3D anatomical meshes. While transformer and mesh networks have recently shown impressive performances in natural language processing and computer vision, their application to medical image analysis has been very limited. To the best of our knowledge, this is the first work that combines transformer and mesh networks. Our results show that TransforMesh can model shape trajectories better than other baseline architectures that do not capture temporal dependencies. Moreover, we also explore the capabilities of TransforMesh in detecting structural anomalies of the hippocampus in patients developing AD.


page 1

page 2

page 3

page 4


CASHformer: Cognition Aware SHape Transformer for Longitudinal Analysis

Modeling temporal changes in subcortical structures is crucial for a bet...

Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs

Structural magnetic resonance imaging (sMRI) is widely used for brain ne...

An Introduction to Transformers

The transformer is a neural network component that can be used to learn ...

Learning Spatio-Temporal Model of Disease Progression with NeuralODEs from Longitudinal Volumetric Data

Robust forecasting of the future anatomical changes inflicted by an ongo...

Robust training of recurrent neural networks to handle missing data for disease progression modeling

Disease progression modeling (DPM) using longitudinal data is a challeng...

Predicting Shape Development: a Riemannian Method

Predicting the future development of an anatomical shape from a single b...

A Review of Mixed-Effect Modeling in the Longitudinal Studies Using Medical Images of Patients

In this review paper, some applications of the mixed effect modeling in ...