Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis

02/20/2020
by   Maxime W. Lafarge, et al.
61

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean motion group SE(2) in convolutional networks to yield translation and rotation equivariance via the introduction of SE(2)-group convolution layers. This structure enables models to learn feature representations with a discretized orientation dimension that guarantees that their outputs are invariant under a discrete set of rotations. Conventional approaches for rotation invariance rely mostly on data augmentation, but this does not guarantee the robustness of the output when the input is rotated. At that, trained conventional CNNs may require test-time rotation augmentation to reach their full capability. This study is focused on histopathology image analysis applications for which it is desirable that the arbitrary global orientation information of the imaged tissues is not captured by the machine learning models. The proposed framework is evaluated on three different histopathology image analysis tasks (mitosis detection, nuclei segmentation and tumor classification). We present a comparative analysis for each problem and show that consistent increase of performances can be achieved when using the proposed framework.

READ FULL TEXT

page 9

page 10

research
04/10/2018

Roto-Translation Covariant Convolutional Networks for Medical Image Analysis

We propose a framework for rotation and translation covariant deep learn...
research
09/27/2021

ML4ML: Automated Invariance Testing for Machine Learning Models

In machine learning workflows, determining invariance qualities of a mod...
research
11/23/2020

Learnable Gabor modulated complex-valued networks for orientation robustness

Robustness to transformation is desirable in many computer vision tasks,...
research
11/29/2022

Equivalence Between SE(3) Equivariant Networks via Steerable Kernels and Group Convolution

A wide range of techniques have been proposed in recent years for design...
research
08/31/2021

Designing Rotationally Invariant Neural Networks from PDEs and Variational Methods

Partial differential equation (PDE) models and their associated variatio...
research
06/24/2023

Regular SE(3) Group Convolutions for Volumetric Medical Image Analysis

Regular group convolutional neural networks (G-CNNs) have been shown to ...
research
03/01/2023

An end-to-end SE(3)-equivariant segmentation network

Convolutional neural networks (CNNs) allow for parameter sharing and tra...

Please sign up or login with your details

Forgot password? Click here to reset