A Survey on GAN Acceleration Using Memory Compression Technique

08/14/2021
by   dina-tantawy, et al.
0

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary deep learning models is the nature of their output. For example, GAN output can be a whole image versus other models detecting objects or classifying images. Thus, the architecture and numeric precision of the network affect the quality and speed of the solution. Hence, accelerating GANs is pivotal. Accelerating GANs can be classified into three main tracks: (1) Memory compression, (2) Computation optimization, and (3) Data-flow optimization. Because data transfer is the main source of energy usage, memory compression leads to the most savings. Thus, in this paper, we survey memory compression techniques for CNN-Based GANs. Additionally, the paper summarizes opportunities and challenges in GANs acceleration and suggests open research problems to be further investigated.

READ FULL TEXT

page 5

page 7

page 9

research
10/05/2022

A Survey of Modern Deep Learning based Generative Adversarial Networks (GANs)

GANs (Generative Adversarial Networks) are a type of deep learning gener...
research
06/15/2020

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

The compression of Generative Adversarial Networks (GANs) has lately dra...
research
05/10/2018

GANAX: A Unified MIMD-SIMD Acceleration for Generative Adversarial Networks

Generative Adversarial Networks (GANs) are one of the most recent deep l...
research
03/22/2021

Evaluating Post-Training Compression in GANs using Locality-Sensitive Hashing

The analysis of the compression effects in generative adversarial networ...
research
01/23/2022

Learning-Driven Lossy Image Compression; A Comprehensive Survey

In the realm of image processing and computer vision (CV), machine learn...
research
06/06/2021

From DNNs to GANs: Review of efficient hardware architectures for deep learning

In recent times, the trend in very large scale integration (VLSI) indust...
research
07/03/2019

Accelerating Deconvolution on Unmodified CNN Accelerators for Generative Adversarial Networks -- A Software Approach

Generative Adversarial Networks (GANs) are the emerging machine learning...

Please sign up or login with your details

Forgot password? Click here to reset