Ensemble Neural Representation Networks

10/07/2021
by   Milad Soltany Kadarvish, et al.
0

Implicit Neural Representation (INR) has recently attracted considerable attention for storing various types of signals in continuous forms. The existing INR networks require lengthy training processes and high-performance computational resources. In this paper, we propose a novel sub-optimal ensemble architecture for INR that resolves the aforementioned problems. In this architecture, the representation task is divided into several sub-tasks done by independent sub-networks. We show that the performance of the proposed ensemble INR architecture may decrease if the dimensions of sub-networks increase. Hence, it is vital to suggest an optimization algorithm to find the sub-optimal structure of the ensemble network, which is done in this paper. According to the simulation results, the proposed architecture not only has significantly fewer floating-point operations (FLOPs) and less training time, but it also has better performance in terms of Peak Signal to Noise Ratio (PSNR) compared to those of its counterparts.

READ FULL TEXT
research
06/20/2018

Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit?

Binary neural networks (BNN) have been studied extensively since they ru...
research
04/09/2019

Intra-Ensemble in Neural Networks

Improving model performance is always the key problem in machine learnin...
research
05/17/2019

Sequential training algorithm for neural networks

A sequential training method for large-scale feedforward neural networks...
research
11/10/2015

Reducing the Training Time of Neural Networks by Partitioning

This paper presents a new method for pre-training neural networks that c...
research
11/07/2018

Gravitational octree code performance evaluation on Volta GPU

In this study, the gravitational octree code originally optimized for th...
research
05/06/2021

Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods

In this paper, we propose a novel ensembling technique for deep neural n...
research
03/19/2019

A Matrix-in-matrix Neural Network for Image Super Resolution

In recent years, deep learning methods have achieved impressive results ...

Please sign up or login with your details

Forgot password? Click here to reset