VarGFaceNet: An Efficient Variable Group Convolutional Neural Network for Lightweight Face Recognition

10/11/2019
by   Mengjia Yan, et al.
0

To improve the discriminative and generalization ability of lightweight network for face recognition, we propose an efficient variable group convolutional network called VarGFaceNet. Variable group convolution is introduced by VarGNet to solve the conflict between small computational cost and the unbalance of computational intensity inside a block. We employ variable group convolution to design our network which can support large scale face identification while reduce computational cost and parameters. Specifically, we use a head setting to reserve essential information at the start of the network and propose a particular embedding setting to reduce parameters of fully-connected layer for embedding. To enhance interpretation ability, we employ an equivalence of angular distillation loss to guide our lightweight network and we apply recursive knowledge distillation to relieve the discrepancy between the teacher model and the student model. The champion of deepglint-light track of LFR (2019) challenge demonstrates the effectiveness of our model and approach. Implementation of VarGFaceNet will be released at https://github.com/zma-c-137/VarGFaceNet soon.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2022

CoupleFace: Relation Matters for Face Recognition Distillation

Knowledge distillation is an effective method to improve the performance...
research
07/12/2019

VarGNet: Variable Group Convolutional Neural Network for Efficient Embedded Computing

In this paper, we propose a novel network design mechanism for efficient...
research
08/24/2021

PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation

Deep neural networks have rapidly become the mainstream method for face ...
research
11/09/2015

A Light CNN for Deep Face Representation with Noisy Labels

Convolution neural network (CNN) has significantly pushed forward the de...
research
12/17/2021

Distill and De-bias: Mitigating Bias in Face Recognition using Knowledge Distillation

Face recognition networks generally demonstrate bias with respect to sen...
research
03/30/2023

Asymmetric Face Recognition with Cross Model Compatible Ensembles

The asymmetrical retrieval setting is a well suited solution for resourc...

Please sign up or login with your details

Forgot password? Click here to reset