ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images

Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias results in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.

READ FULL TEXT

page 9

page 12

research
09/28/2018

DeepSSM: A Deep Learning Framework for Statistical Shape Modeling from Raw Images

Statistical shape modeling is an important tool to characterize variatio...
research
10/14/2021

DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models

Statistical shape modeling (SSM) characterizes anatomical variations in ...
research
07/15/2019

Deep Sequential Mosaicking of Fetoscopic Videos

Twin-to-twin transfusion syndrome treatment requires fetoscopic laser ph...
research
05/22/2020

Polarimetric image augmentation

Robotics applications in urban environments are subject to obstacles tha...
research
07/19/2022

Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detection

Lung nodule detection in chest X-ray (CXR) images is common to early scr...
research
11/14/2022

Robustifying Deep Vision Models Through Shape Sensitization

Recent work has shown that deep vision models tend to be overly dependen...
research
10/17/2019

Anatomically-Informed Data Augmentation for functional MRI with Applications to Deep Learning

The application of deep learning to build accurate predictive models fro...

Please sign up or login with your details

Forgot password? Click here to reset