Equivariant Networks for Pixelized Spheres

06/12/2021
by   Mehran Shakerinava, et al.
0

Pixelizations of Platonic solids such as the cube and icosahedron have been widely used to represent spherical data, from climate records to Cosmic Microwave Background maps. Platonic solids have well-known global symmetries. Once we pixelize each face of the solid, each face also possesses its own local symmetries in the form of Euclidean isometries. One way to combine these symmetries is through a hierarchy. However, this approach does not adequately model the interplay between the two levels of symmetry transformations. We show how to model this interplay using ideas from group theory, identify the equivariant linear maps, and introduce equivariant padding that respects these symmetries. Deep networks that use these maps as their building blocks generalize gauge equivariant CNNs on pixelized spheres. These deep networks achieve state-of-the-art results on semantic segmentation for climate data and omnidirectional image processing. Code is available at https://git.io/JGiZA.

READ FULL TEXT
research
06/05/2020

Equivariant Maps for Hierarchical Structures

In many real-world settings, we are interested in learning invariant and...
research
07/05/2023

Spherical Feature Pyramid Networks For Semantic Segmentation

Semantic segmentation for spherical data is a challenging problem in mac...
research
05/28/2021

Geometric Deep Learning and Equivariant Neural Networks

We survey the mathematical foundations of geometric deep learning, focus...
research
04/07/2022

L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentation

Mining precise class-aware attention maps, a.k.a, class activation maps,...
research
02/11/2019

Gauge Equivariant Convolutional Networks and the Icosahedral CNN

The idea of equivariance to symmetry transformations provides one of the...
research
11/13/2017

Visual Concepts and Compositional Voting

It is very attractive to formulate vision in terms of pattern theory Mum...

Please sign up or login with your details

Forgot password? Click here to reset