Realizing Neural Decoder at the Edge with Ensembled BNN

06/18/2021
by   Devannagari Vikas, et al.
0

In this work, we propose extreme compression techniques like binarization, ternarization for Neural Decoders such as TurboAE. These methods reduce memory and computation by a factor of 64 with a performance better than the quantized (with 1-bit or 2-bits) Neural Decoders. However, because of the limited representation capability of the Binary and Ternary networks, the performance is not as good as the real-valued decoder. To fill this gap, we further propose to ensemble 4 such weak performers to deploy in the edge to achieve a performance similar to the real-valued network. These ensemble decoders give 16 and 64 times saving in memory and computation respectively and help to achieve performance similar to real-valued TurboAE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/04/2018

Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance

In this paper, we study 1-bit convolutional neural networks (CNNs), of w...
research
11/03/2021

Neural network is heterogeneous: Phase matters more

We find a heterogeneity in both complex and real valued neural networks ...
research
10/27/2021

Binarized ResNet: Enabling Automatic Modulation Classification at the resource-constrained Edge

In this paper, we propose a ResNet based neural architecture to solve th...
research
09/26/2019

Overparameterized Neural Networks Can Implement Associative Memory

Identifying computational mechanisms for memorization and retrieval is a...
research
10/12/2021

Improving Binary Neural Networks through Fully Utilizing Latent Weights

Binary Neural Networks (BNNs) rely on a real-valued auxiliary variable W...
research
05/21/2018

Sample Compression for Real-Valued Learners

We give an algorithmically efficient version of the learner-to-compressi...
research
03/27/2013

Knowledge and Uncertainty

One purpose -- quite a few thinkers would say the main purpose -- of see...

Please sign up or login with your details

Forgot password? Click here to reset