Rubik's Cube Operator: A Plug And Play Permutation Module for Better Arranging High Dimensional Industrial Data in Deep Convolutional Processes

by   Luoxiao Yang, et al.

The convolutional neural network (CNN) has been widely applied to process the industrial data based tensor input, which integrates data records of distributed industrial systems from the spatial, temporal, and system dynamics aspects. However, unlike images, information in the industrial data based tensor is not necessarily spatially ordered. Thus, directly applying CNN is ineffective. To tackle such issue, we propose a plug and play module, the Rubik's Cube Operator (RCO), to adaptively permutate the data organization of the industrial data based tensor to an optimal or suboptimal order of attributes before being processed by CNNs, which can be updated with subsequent CNNs together via the gradient-based optimizer. The proposed RCO maintains K binary and right stochastic permutation matrices to permutate attributes of K axes of the input industrial data based tensor. A novel learning process is proposed to enable learning permutation matrices from data, where the Gumbel-Softmax is employed to reparameterize elements of permutation matrices, and the soft regularization loss is proposed and added to the task-specific loss to ensure the feature diversity of the permuted data. We verify the effectiveness of the proposed RCO via considering two representative learning tasks processing industrial data via CNNs, the wind power prediction (WPP) and the wind speed prediction (WSP) from the renewable energy domain. Computational experiments are conducted based on four datasets collected from different wind farms and the results demonstrate that the proposed RCO can improve the performance of CNN based networks significantly.


page 1

page 2

page 5

page 8

page 9

page 10


DeepPermNet: Visual Permutation Learning

We present a principled approach to uncover the structure of visual data...

Intelligent Icing Detection Model of Wind Turbine Blades Based on SCADA data

Diagnosis of ice accretion on wind turbine blades is all the time a hard...

Scene Learning: Deep Convolutional Networks For Wind Power Prediction by Embedding Turbines into Grid Space

Wind power prediction is of vital importance in wind power utilization. ...

A Concurrent CNN-RNN Approach for Multi-Step Wind Power Forecasting

Wind power forecasting helps with the planning for the power systems by ...

Wind Speed Prediction using Deep Ensemble Learning with a Jet-like Architecture

Accurate and reliable prediction of wind speed is a challenging task, be...

Rethinking Gradient Operator for Exposing AI-enabled Face Forgeries

For image forensics, convolutional neural networks (CNNs) tend to learn ...

Please sign up or login with your details

Forgot password? Click here to reset