Regular SE(3) Group Convolutions for Volumetric Medical Image Analysis

06/24/2023
by   Thijs P. Kuipers, et al.
0

Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-translation equivariance, on volumetric data. Volumetric image data is prevalent in many medical settings. Motivated by the recent work on separable group convolutions, we devise a SE(3) group convolution kernel separated into a continuous SO(3) (rotation) kernel and a spatial kernel. We approximate equivariance to the continuous setting by sampling uniform SO(3) grids. Our continuous SO(3) kernel is parameterized via RBF interpolation on similarly uniform grids. We demonstrate the advantages of our approach in volumetric medical image analysis. Our SE(3) equivariant models consistently outperform CNNs and regular discrete G-CNNs on challenging medical classification tasks and show significantly improved generalization capabilities. Our approach achieves up to a 16.5

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2018

Roto-Translation Covariant Convolutional Networks for Medical Image Analysis

We propose a framework for rotation and translation covariant deep learn...
research
07/06/2018

3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data

We present a convolutional network that is equivariant to rigid body mot...
research
06/04/2021

DISCO: accurate Discrete Scale Convolutions

Scale is often seen as a given, disturbing factor in many vision tasks. ...
research
05/14/2019

3D Dense Separated Convolution Module for Volumetric Image Analysis

With the thriving of deep learning, 3D Convolutional Neural Networks hav...
research
02/20/2020

Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis

Rotation-invariance is a desired property of machine-learning models for...
research
03/01/2023

An end-to-end SE(3)-equivariant segmentation network

Convolutional neural networks (CNNs) allow for parameter sharing and tra...
research
01/24/2020

PDE-based Group Equivariant Convolutional Neural Networks

We present a PDE-based framework that generalizes Group equivariant Conv...

Please sign up or login with your details

Forgot password? Click here to reset