research
∙
07/17/2023
Cumulative Spatial Knowledge Distillation for Vision Transformers
Distilling knowledge from convolutional neural networks (CNNs) is a doub...
share
research
∙
07/17/2023
DOT: A Distillation-Oriented Trainer
Knowledge distillation transfers knowledge from a large model to a small...
research
∙
04/21/2023
Joint Token Pruning and Squeezing Towards More Aggressive Compression of Vision Transformers
Although vision transformers (ViTs) have shown promising results in vari...
research
∙
03/20/2023
Boosting Semi-Supervised Learning by Exploiting All Unlabeled Data
Semi-supervised learning (SSL) has attracted enormous attention due to i...
research
∙
10/26/2022
SimpleDG: Simple Domain Generalization Baseline without Bells and Whistles
We present a simple domain generalization baseline, which wins second pl...
research
∙
10/26/2022
Towards A Robust Deepfake Detector:Common Artifact Deepfake Detection Model
Existing deepfake detection methods perform poorly on face forgeries gen...
research
∙
07/26/2022
Efficient One Pass Self-distillation with Zipf's Label Smoothing
Self-distillation exploits non-uniform soft supervision from itself duri...
research
∙
07/20/2022
Explaining Deepfake Detection by Analysing Image Matching
This paper aims to interpret how deepfake detection models learn artifac...
research
∙
03/16/2022
Decoupled Knowledge Distillation
State-of-the-art distillation methods are mainly based on distilling dee...
research
∙
01/29/2021
Information Theoretic Limits of Exact Recovery in Sub-hypergraph Models for Community Detection
In this paper, we study the information theoretic bounds for exact recov...
research
∙
09/18/2018
Scene Text Recognition from Two-Dimensional Perspective
Inspired by speech recognition, recent state-of-the-art algorithms mostl...
research
∙
04/11/2017