NL-CNN: A Resources-Constrained Deep Learning Model based on Nonlinear Convolution

01/30/2021
by   Radu Dogaru, et al.
0

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly available. Performance evaluation for several widely known datasets is provided, showing several relevant features: i) for small / medium input image sizes the proposed network gives very good testing accuracy, given a low implementation complexity and model size; ii) compares favorably with other widely known resources-constrained models, for instance in comparison to MobileNetv2 provides better accuracy with several times less training times and up to ten times less parameters (memory occupied by the model); iii) has a relevant set of hyper-parameters which can be easily and rapidly tuned due to the fast training specific to it. All these features make NL-CNN suitable for IoT, smart sensing, bio-medical portable instrumentation and other applications where artificial intelligence must be deployed in energy-constrained environments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2021

AdderNet and its Minimalist Hardware Design for Energy-Efficient Artificial Intelligence

Convolutional neural networks (CNN) have been widely used for boosting t...
research
09/30/2019

EdgeCNN: Convolutional Neural Network Classification Model with small inputs for Edge Computing

With the development of Internet of Things (IoT), data is increasingly a...
research
04/22/2018

Micro-Net: A unified model for segmentation of various objects in microscopy images

Object segmentation and structure localization are important steps in au...
research
11/01/2021

Fast Convolution based on Winograd Minimum Filtering: Introduction and Development

Convolutional Neural Network (CNN) has been widely used in various field...
research
05/05/2020

Adaptive Low-Rank Factorization to regularize shallow and deep neural networks

The overfitting is one of the cursing subjects in the deep learning fiel...
research
10/06/2016

Metaheuristic Algorithms for Convolution Neural Network

A typical modern optimization technique is usually either heuristic or m...
research
01/23/2023

FInC Flow: Fast and Invertible k × k Convolutions for Normalizing Flows

Invertible convolutions have been an essential element for building expr...

Please sign up or login with your details

Forgot password? Click here to reset