Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks

10/14/2022
by   Renan A. Rojas-Gomez, et al.
0

We propose learnable polyphase sampling (LPS), a pair of learnable down/upsampling layers that enable truly shift-invariant and equivariant convolutional networks. LPS can be trained end-to-end from data and generalizes existing handcrafted downsampling layers. It is widely applicable as it can be integrated into any convolutional network by replacing down/upsampling layers. We evaluate LPS on image classification and semantic segmentation. Experiments show that LPS is on-par with or outperforms existing methods in both performance and shift consistency. For the first time, we achieve true shift-equivariance on semantic segmentation (PASCAL VOC), i.e., 100 consistency, outperforming baselines by an absolute 3.3

READ FULL TEXT

page 9

page 15

page 16

page 17

page 18

page 20

research
03/09/2015

Fully Connected Deep Structured Networks

Convolutional neural networks with many layers have recently been shown ...
research
11/28/2020

Truly shift-invariant convolutional neural networks

Thanks to the use of convolution and pooling layers, convolutional neura...
research
04/18/2016

ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation

Large-scale data is of crucial importance for learning semantic segmenta...
research
10/11/2022

Hypergraph Convolutional Networks for Weakly-Supervised Semantic Segmentation

Semantic segmentation is a fundamental topic in computer vision. Several...
research
05/09/2021

Truly shift-equivariant convolutional neural networks with adaptive polyphase upsampling

Convolutional neural networks lack shift equivariance due to the presenc...
research
04/25/2018

Learnable Histogram: Statistical Context Features for Deep Neural Networks

Statistical features, such as histogram, Bag-of-Words (BoW) and Fisher V...
research
03/07/2019

A Learnable ScatterNet: Locally Invariant Convolutional Layers

In this paper we explore tying together the ideas from Scattering Transf...

Please sign up or login with your details

Forgot password? Click here to reset