Attentive CutMix: An Enhanced Data Augmentation Approach for Deep Learning Based Image Classification

03/29/2020
by   Devesh Walawalkar, et al.
0

Convolutional neural networks (CNN) are capable of learning robust representation with different regularization methods and activations as convolutional layers are spatially correlated. Based on this property, a large variety of regional dropout strategies have been proposed, such as Cutout, DropBlock, CutMix, etc. These methods aim to promote the network to generalize better by partially occluding the discriminative parts of objects. However, all of them perform this operation randomly, without capturing the most important region(s) within an object. In this paper, we propose Attentive CutMix, a naturally enhanced augmentation strategy based on CutMix. In each training iteration, we choose the most descriptive regions based on the intermediate attention maps from a feature extractor, which enables searching for the most discriminative parts in an image. Our proposed method is simple yet effective, easy to implement and can boost the baseline significantly. Extensive experiments on CIFAR-10/100, ImageNet datasets with various CNN architectures (in a unified setting) demonstrate the effectiveness of our proposed method, which consistently outperforms the baseline CutMix and other methods by a significant margin.

READ FULL TEXT

page 1

page 2

research
05/13/2019

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

Regional dropout strategies have been proposed to enhance the performanc...
research
01/26/2019

See Better Before Looking Closer: Weakly Supervised Data Augmentation Network for Fine-Grained Visual Classification

Data augmentation is usually adopted to increase the amount of training ...
research
03/30/2018

Parallel Grid Pooling for Data Augmentation

Convolutional neural network (CNN) architectures utilize downsampling la...
research
03/29/2021

FocusedDropout for Convolutional Neural Network

In convolutional neural network (CNN), dropout cannot work well because ...
research
02/22/2018

Improved Techniques For Weakly-Supervised Object Localization

We propose an improved technique for weakly-supervised object localizati...
research
06/02/2020

SaliencyMix: A Saliency Guided Data Augmentation Strategy for Better Regularization

Advanced data augmentation strategies have widely been studied to improv...
research
08/22/2017

CNN Fixations: An unraveling approach to visualize the discriminative image regions

Deep convolutional neural networks (CNN) have revolutionized various fie...

Please sign up or login with your details

Forgot password? Click here to reset