RepVGG: Making VGG-style ConvNets Great Again

01/11/2021
by   Xiaohan Ding, et al.
6

We present a simple but powerful architecture of convolutional neural network, which has a VGG-like inference-time body composed of nothing but a stack of 3x3 convolution and ReLU, while the training-time model has a multi-branch topology. Such decoupling of the training-time and inference-time architecture is realized by a structural re-parameterization technique so that the model is named RepVGG. On ImageNet, RepVGG reaches over 80% top-1 accuracy, which is the first time for a plain model, to the best of our knowledge. On NVIDIA 1080Ti GPU, RepVGG models run 83 101 accuracy-speed trade-off compared to the state-of-the-art models like EfficientNet and RegNet. The code and trained models are available at https://github.com/megvii-model/RepVGG.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2022

Online Convolutional Re-parameterization

Structural re-parameterization has drawn increasing attention in various...
research
03/24/2021

Diverse Branch Block: Building a Convolution as an Inception-like Unit

We propose a universal building block of Convolutional Neural Network (C...
research
05/30/2022

Re-parameterizing Your Optimizers rather than Architectures

The well-designed structures in neural networks reflect the prior knowle...
research
06/09/2023

Spatial Re-parameterization for N:M Sparsity

This paper presents a Spatial Re-parameterization (SpRe) method for the ...
research
03/24/2022

DyRep: Bootstrapping Training with Dynamic Re-parameterization

Structural re-parameterization (Rep) methods achieve noticeable improvem...
research
09/02/2019

Training-Time-Friendly Network for Real-Time Object Detection

Modern object detectors can rarely achieve short training time, fast inf...
research
10/26/2021

CS-Rep: Making Speaker Verification Networks Embracing Re-parameterization

Automatic speaker verification (ASV) systems, which determine whether tw...

Please sign up or login with your details

Forgot password? Click here to reset