Bag of Tricks for Image Classification with Convolutional Neural Networks

12/04/2018
by   Junyuan Xie, et al.
18

Much of the recent progress made in image classification research can be credited to training procedure refinements, such as changes in data augmentations and optimization methods. In the literature, however, most refinements are either briefly mentioned as implementation details or only visible in source code. In this paper, we will examine a collection of such refinements and empirically evaluate their impact on the final model accuracy through ablation study. We will show that, by combining these refinements together, we are able to improve various CNN models significantly. For example, we raise ResNet-50's top-1 validation accuracy from 75.3 ImageNet. We will also demonstrate that improvement on image classification accuracy leads to better transfer learning performance in other application domains such as object detection and semantic segmentation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2021

Bag of Tricks of Semi-Supervised Classification with Graph Neural Networks

Much of the recent progress made in node classification on graphs can be...
research
04/08/2022

Does Robustness on ImageNet Transfer to Downstream Tasks?

As clean ImageNet accuracy nears its ceiling, the research community is ...
research
07/27/2022

Multi-layer Representation Learning for Robust OOD Image Classification

Convolutional Neural Networks have become the norm in image classificati...
research
01/17/2020

Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network

Recent studies in image classification have demonstrated a variety of te...
research
05/15/2023

Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks

This work examines the challenges of training neural networks using vect...
research
06/16/2020

Improving accuracy and speeding up Document Image Classification through parallel systems

This paper presents a study showing the benefits of the EfficientNet mod...
research
10/22/2020

Efficient Scale-Permuted Backbone with Learned Resource Distribution

Recently, SpineNet has demonstrated promising results on object detectio...

Please sign up or login with your details

Forgot password? Click here to reset