Data Represention for Deep Learning with Priori Knowledge of Symmetric Wireless Tasks

05/18/2020
by   Chengjian Sun, et al.
0

Deep neural networks (DNNs) have been applied to address various wireless tasks, which usually need a large number of samples for training. Considering that wireless networks are highly dynamic and gathering data is expensive, it is paramount to reduce the sample complexity. Incorporating domain knowledge into learning is a promising way of decreasing training samples. Yet how to invoke priori knowledge of wireless tasks for efficient data representation remains largely unexplored. In this article, we first briefly summarize several approaches to address training complexity. Then, we show that a symmetric property, permutation equivariance, widely exists in wireless tasks. We introduce a simple method to compress the training set by exploiting such a generic prior, which is to jointly sort the input and output of the DNNs. We use interference coordination and caching policy optimization to illustrate how to apply this method of data representation, i.e., ranking, and how much the sample complexity can be reduced. Simulation results demonstrate that the training samples required to achieve the same performance as the traditional data representation can be reduced by 10 ∼ 200 folds by ranking.

READ FULL TEXT
research
01/29/2020

Constructing Deep Neural Networks with a Priori Knowledge of Wireless Tasks

Deep neural networks (DNNs) have been employed for designing wireless sy...
research
10/30/2019

Structure of Deep Neural Networks with a Priori Information in Wireless Tasks

Deep neural networks (DNNs) have been employed for designing wireless ne...
research
11/06/2020

Learning Power Control for Cellular Systems with Heterogeneous Graph Neural Network

Optimizing power control in multi-cell cellular networks with deep learn...
research
03/29/2023

Polarity is all you need to learn and transfer faster

Natural intelligences (NIs) thrive in a dynamic world - they learn quick...
research
02/07/2022

Towards an Analytical Definition of Sufficient Data

We show that, for each of five datasets of increasing complexity, certai...
research
12/18/2018

LORA: Learning to Optimize for Resource Allocation in Wireless Networks with Few Training Samples

Effective resource allocation plays a pivotal role for performance optim...
research
06/30/2020

Boosting Deep Neural Networks with Geometrical Prior Knowledge: A Survey

While Deep Neural Networks (DNNs) achieve state-of-the-art results in ma...

Please sign up or login with your details

Forgot password? Click here to reset