-
Rethinking Spatial Dimensions of Vision Transformers
Vision Transformer (ViT) extends the application range of transformers f...
03/30/2021 ∙ by Byeongho Heo, et al. ∙
6
∙
share
read it
-
Show, Attend and Distill:Knowledge Distillation via Attention-based Feature Matching
Knowledge distillation extracts general knowledge from a pre-trained tea...
02/05/2021 ∙ by Mingi Ji, et al. ∙
2
∙
share
read it
-
Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels
ImageNet has been arguably the most popular image classification benchma...
01/13/2021 ∙ by Sangdoo Yun, et al. ∙
21
∙
share
read it
-
VideoMix: Rethinking Data Augmentation for Video Classification
State-of-the-art video action classifiers often suffer from overfitting....
12/07/2020 ∙ by Sangdoo Yun, et al. ∙
0
∙
share
read it
-
ReXNet: Diminishing Representational Bottleneck on Convolutional Neural Network
This paper addresses representational bottleneck in a network and propos...
07/02/2020 ∙ by Dongyoon Han, et al. ∙
0
∙
share
read it
-
Slowing Down the Weight Norm Increase in Momentum-based Optimizers
Normalization techniques, such as batch normalization (BN), have led to ...
06/15/2020 ∙ by Byeongho Heo, et al. ∙
16
∙
share
read it
-
A Comprehensive Overhaul of Feature Distillation
We investigate the design aspects of feature distillation methods achiev...
04/03/2019 ∙ by Byeongho Heo, et al. ∙
0
∙
share
read it
-
Backbone Can Not be Trained at Once: Rolling Back to Pre-trained Network for Person Re-Identification
In person re-identification (ReID) task, because of its shortage of trai...
01/18/2019 ∙ by Youngmin Ro, et al. ∙
0
∙
share
read it
-
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons
An activation boundary for a neuron refers to a separating hyperplane th...
11/08/2018 ∙ by Byeongho Heo, et al. ∙
0
∙
share
read it
-
Knowledge Distillation with Adversarial Samples Supporting Decision Boundary
Many recent works on knowledge distillation have provided ways to transf...
05/15/2018 ∙ by Byeongho Heo, et al. ∙
0
∙
share
read it
-
Improving Knowledge Distillation with Supporting Adversarial Samples
Many recent works on knowledge distillation have provided ways to transf...
05/15/2018 ∙ by Byeongho Heo, et al. ∙
0
∙
share
read it
