Distilling portable Generative Adversarial Networks for Image Translation

03/07/2020
by   Hanting Chen, et al.
13

Despite Generative Adversarial Networks (GANs) have been widely used in various image-to-image translation tasks, they can be hardly applied on mobile devices due to their heavy computation and storage cost. Traditional network compression methods focus on visually recognition tasks, but never deal with generation tasks. Inspired by knowledge distillation, a student generator of fewer parameters is trained by inheriting the low-level and high-level information from the original heavy teacher generator. To promote the capability of student generator, we include a student discriminator to measure the distances between real images, and images generated by student and teacher generators. An adversarial learning process is therefore established to optimize student generator and student discriminator. Qualitative and quantitative analysis by conducting experiments on benchmark datasets demonstrate that the proposed method can learn portable generative models with strong performance.

READ FULL TEXT

page 2

page 5

page 6

page 7

research
04/30/2021

Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translation

Generative adversarial networks (GANs) have shown significant potential ...
research
05/25/2022

Region-aware Knowledge Distillation for Efficient Image-to-Image Translation

Recent progress in image-to-image translation has witnessed the success ...
research
07/25/2019

Co-Evolutionary Compression for Unpaired Image Translation

Generative adversarial networks (GANs) have been successfully used for c...
research
04/02/2019

Data-Free Learning of Student Networks

Learning portable neural networks is very essential for computer vision ...
research
12/20/2022

End to End Generative Meta Curriculum Learning For Medical Data Augmentation

Current medical image synthetic augmentation techniques rely on intensiv...
research
08/17/2021

Transferring Knowledge with Attention Distillation for Multi-Domain Image-to-Image Translation

Gradient-based attention modeling has been used widely as a way to visua...
research
03/05/2021

Teachers Do More Than Teach: Compressing Image-to-Image Models

Generative Adversarial Networks (GANs) have achieved huge success in gen...

Please sign up or login with your details

Forgot password? Click here to reset