Distilling knowledge from convolutional neural networks (CNNs) is a
doub...
Knowledge distillation transfers knowledge from a large model to a small...
Semi-supervised learning (SSL) has attracted enormous attention due to i...
State-of-the-art distillation methods are mainly based on distilling dee...