SPIN: Simplifying Polar Invariance for Neural networks Application to vision-based irradiance forecasting

11/29/2021
by   Quentin Paletta, et al.
0

Translational invariance induced by pooling operations is an inherent property of convolutional neural networks, which facilitates numerous computer vision tasks such as classification. Yet to leverage rotational invariant tasks, convolutional architectures require specific rotational invariant layers or extensive data augmentation to learn from diverse rotated versions of a given spatial configuration. Unwrapping the image into its polar coordinates provides a more explicit representation to train a convolutional architecture as the rotational invariance becomes translational, hence the visually distinct but otherwise equivalent rotated versions of a given scene can be learnt from a single image. We show with two common vision-based solar irradiance forecasting challenges (i.e. using ground-taken sky images or satellite images), that this preprocessing step significantly improves prediction results by standardising the scene representation, while decreasing training time by a factor of 4 compared to augmenting data with rotations. In addition, this transformation magnifies the area surrounding the centre of the rotation, leading to more accurate short-term irradiance predictions.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 7

page 11

page 12

page 16

research
07/21/2020

CyCNN: A Rotation Invariant CNN using Polar Mapping and Cylindrical Convolution Layers

Deep Convolutional Neural Networks (CNNs) are empirically known to be in...
research
03/01/2017

Graph-based Isometry Invariant Representation Learning

Learning transformation invariant representations of visual data is an i...
research
01/27/2020

¶ILCRO: Making Importance Landscapes Flat Again

Convolutional neural networks have had a great success in numerous tasks...
research
05/23/2023

Sorted Convolutional Network for Achieving Continuous Rotational Invariance

The topic of achieving rotational invariance in convolutional neural net...
research
06/18/2021

Towards interpreting computer vision based on transformation invariant optimization

Interpreting how does deep neural networks (DNNs) make predictions is a ...
research
04/01/2019

Equivariant Multi-View Networks

Several approaches to 3D vision tasks process multiple views of the inpu...
research
07/09/2021

SITHCon: A neural network robust to variations in input scaling on the time dimension

In machine learning, convolutional neural networks (CNNs) have been extr...

Please sign up or login with your details

Forgot password? Click here to reset