A Unified Hardware Architecture for Convolutions and Deconvolutions in CNN

05/29/2020
by   Lin Bai, et al.
0

In this paper, a scalable neural network hardware architecture for image segmentation is proposed. By sharing the same computing resources, both convolution and deconvolution operations are handled by the same process element array. In addition, access to on-chip and off-chip memories is optimized to alleviate the burden introduced by partial sum. As an example, SegNet-Basic has been implemented using the proposed unified architecture by targeting on Xilinx ZC706 FPGA, which achieves the performance of 151.5 GOPS and 94.3 GOPS for convolution and deconvolution respectively. This unified convolution/deconvolution design is applicable to other CNNs with deconvolution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2017

Properties on n-dimensional convolution for image deconvolution

Convolution system is linear and time invariant, and can describe the op...
research
07/09/2021

WinoCNN: Kernel Sharing Winograd Systolic Array for Efficient Convolutional Neural Network Acceleration on FPGAs

The combination of Winograd's algorithm and systolic array architecture ...
research
09/03/2018

A CNN Accelerator on FPGA Using Depthwise Separable Convolution

Convolutional neural networks (CNNs) have been widely deployed in the fi...
research
09/11/2020

Boosting the Sliding Frank-Wolfe solver for 3D deconvolution

In the context of gridless sparse optimization, the Sliding Frank Wolfe ...
research
06/29/2023

Performance Analysis of DNN Inference/Training with Convolution and non-Convolution Operations

Today's performance analysis frameworks for deep learning accelerators s...
research
11/18/2019

Efficient Hardware Implementation of Incremental Learning and Inference on Chip

In this paper, we tackle the problem of incrementally learning a classif...
research
07/10/2017

Checkerboard artifact free sub-pixel convolution: A note on sub-pixel convolution, resize convolution and convolution resize

The most prominent problem associated with the deconvolution layer is th...

Please sign up or login with your details

Forgot password? Click here to reset