From Images to Probabilistic Anatomical Shapes: A Deep Variational Bottleneck Approach

05/13/2022
by   Jadie Adams, et al.
0

Statistical shape modeling (SSM) directly from 3D medical images is an underutilized tool for detecting pathology, diagnosing disease, and conducting population-level morphology analysis. Deep learning frameworks have increased the feasibility of adopting SSM in medical practice by reducing the expert-driven manual and computational overhead in traditional SSM workflows. However, translating such frameworks to clinical practice requires calibrated uncertainty measures as neural networks can produce over-confident predictions that cannot be trusted in sensitive clinical decision-making. Existing techniques for predicting shape with aleatoric (data-dependent) uncertainty utilize a principal component analysis (PCA) based shape representation computed in isolation from the model training. This constraint restricts the learning task to solely estimating pre-defined shape descriptors from 3D images and imposes a linear relationship between this shape representation and the output (i.e., shape) space. In this paper, we propose a principled framework based on the variational information bottleneck theory to relax these assumptions while predicting probabilistic shapes of anatomy directly from images without supervised encoding of shape descriptors. Here, the latent representation is learned in the context of the learning task, resulting in a more scalable, flexible model that better captures data non-linearity. Additionally, this model is self-regularized and generalizes better given limited training data. Our experiments demonstrate that the proposed method provides improved accuracy and better calibrated aleatoric uncertainty estimates than state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2023

Fully Bayesian VIB-DeepSSM

Statistical shape modeling (SSM) enables population-based quantitative a...
research
10/14/2021

DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models

Statistical shape modeling (SSM) characterizes anatomical variations in ...
research
07/13/2020

Uncertain-DeepSSM: From Images to Probabilistic Shape Models

Statistical shape modeling (SSM) has recently taken advantage of advance...
research
08/06/2018

Deep Shape Analysis on Abdominal Organs for Diabetes Prediction

Morphological analysis of organs based on images is a key task in medica...
research
07/03/2019

A Variational Model Dedicated to Joint Segmentation, Registration and Atlas Generation for Shape Analysis

In medical image analysis, constructing an atlas, i.e. a mean representa...
research
07/30/2018

Uncertainty Quantification in CNN-Based Surface Prediction Using Shape Priors

Surface reconstruction is a vital tool in a wide range of areas of medic...
research
08/14/2023

Semantify: Simplifying the Control of 3D Morphable Models using CLIP

We present Semantify: a self-supervised method that utilizes the semanti...

Please sign up or login with your details

Forgot password? Click here to reset