DISCO: accurate Discrete Scale Convolutions

06/04/2021
by   Ivan Sosnovik, et al.
14

Scale is often seen as a given, disturbing factor in many vision tasks. When doing so it is one of the factors why we need more data during learning. In recent work scale equivariance was added to convolutional neural networks. It was shown to be effective for a range of tasks. We aim for accurate scale-equivariant convolutional neural networks (SE-CNNs) applicable for problems where high granularity of scale and small filter sizes are required. Current SE-CNNs rely on weight sharing and filter rescaling, the latter of which is accurate for integer scales only. To reach accurate scale equivariance, we derive general constraints under which scale-convolution remains equivariant to discrete rescaling. We find the exact solution for all cases where it exists, and compute the approximation for the rest. The discrete scale-convolution pays off, as demonstrated in a new state-of-the-art classification on MNIST-scale and improving the results on STL-10. With the same SE scheme, we also improve the computational effort of a scale-equivariant Siamese tracker on OTB-13.

READ FULL TEXT

page 8

page 12

research
02/24/2016

Group Equivariant Convolutional Networks

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a...
research
06/24/2023

Regular SE(3) Group Convolutions for Volumetric Medical Image Analysis

Regular group convolutional neural networks (G-CNNs) have been shown to ...
research
06/19/2020

From Discrete to Continuous Convolution Layers

A basic operation in Convolutional Neural Networks (CNNs) is spatial res...
research
07/31/2018

Scale equivariance in CNNs with vector fields

We study the effect of injecting local scale equivariance into Convoluti...
research
10/24/2022

A Continuous Convolutional Trainable Filter for Modelling Unstructured Data

Convolutional Neural Network (CNN) is one of the most important architec...
research
11/29/2022

Equivalence Between SE(3) Equivariant Networks via Steerable Kernels and Group Convolution

A wide range of techniques have been proposed in recent years for design...

Please sign up or login with your details

Forgot password? Click here to reset