Compressing Facial Makeup Transfer Networks by Collaborative Distillation and Kernel Decomposition

09/16/2020
by   Bianjiang Yang, et al.
0

Although the facial makeup transfer network has achieved high-quality performance in generating perceptually pleasing makeup images, its capability is still restricted by the massive computation and storage of the network architecture. We address this issue by compressing facial makeup transfer networks with collaborative distillation and kernel decomposition. The main idea of collaborative distillation is underpinned by a finding that the encoder-decoder pairs construct an exclusive collaborative relationship, which is regarded as a new kind of knowledge for low-level vision tasks. For kernel decomposition, we apply the depth-wise separation of convolutional kernels to build a light-weighted Convolutional Neural Network (CNN) from the original network. Extensive experiments show the effectiveness of the compression method when applied to the state-of-the-art facial makeup transfer network – BeautyGAN.

READ FULL TEXT

page 2

page 4

research
03/18/2020

Collaborative Distillation for Ultra-Resolution Universal Style Transfer

Universal style transfer methods typically leverage rich representations...
research
06/20/2022

Knowledge Distillation for Oriented Object Detection on Aerial Images

Deep convolutional neural network with increased number of parameters ha...
research
07/24/2023

A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation

In this paper, we strive to answer the question "how to collaboratively ...
research
12/12/2020

Periocular in the Wild Embedding Learning with Cross-Modal Consistent Knowledge Distillation

Periocular biometric, or peripheral area of ocular, is a collaborative a...
research
10/09/2020

Be Your Own Best Competitor! Multi-Branched Adversarial Knowledge Transfer

Deep neural network architectures have attained remarkable improvements ...
research
03/18/2023

Channel-Aware Distillation Transformer for Depth Estimation on Nano Drones

Autonomous navigation of drones using computer vision has achieved promi...

Please sign up or login with your details

Forgot password? Click here to reset