XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

03/16/2016
by   Mohammad Rastegari, et al.
0

We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32x memory saving. In XNOR-Networks, both the filters and the input to convolutional layers are binary. XNOR-Networks approximate convolutions using primarily binary operations. This results in 58x faster convolutional operations and 32x memory savings. XNOR-Nets offer the possibility of running state-of-the-art networks on CPUs (rather than GPUs) in real-time. Our binary networks are simple, accurate, efficient, and work on challenging visual tasks. We evaluate our approach on the ImageNet classification task. The classification accuracy with a Binary-Weight-Network version of AlexNet is only 2.9 full-precision AlexNet (in top-1 measure). We compare our method with recent network binarization methods, BinaryConnect and BinaryNets, and outperform these methods by large margins on ImageNet, more than 16

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2017

Towards Accurate Binary Convolutional Neural Network

We introduce a novel scheme to train binary convolutional neural network...
research
04/11/2016

Binarized Neural Networks on the ImageNet Classification Task

We trained Binarized Neural Networks (BNNs) on the high resolution Image...
research
07/29/2020

Fully Dynamic Inference with Deep Neural Networks

Modern deep neural networks are powerful and widely applicable models th...
research
11/07/2018

Median Binary-Connect Method and a Binary Convolutional Neural Nework for Word Recognition

We propose and study a new projection formula for training binary weight...
research
05/26/2020

Learning to map between ferns with differentiable binary embedding networks

Current deep learning methods are based on the repeated, expensive appli...
research
06/07/2017

Network Sketching: Exploiting Binary Structure in Deep CNNs

Convolutional neural networks (CNNs) with deep architectures have substa...
research
09/30/2019

XNOR-Net++: Improved Binary Neural Networks

This paper proposes an improved training algorithm for binary neural net...

Please sign up or login with your details

Forgot password? Click here to reset