Dynamic Data Augmentation with Gating Networks

11/05/2021
by   Daisuke Oba, et al.
0

Data augmentation is a technique to improve the generalization ability of machine learning methods by increasing the size of the dataset. However, since every augmentation method is not equally effective for every dataset, you need to carefully select the best method. We propose a neural network that dynamically selects the best combination using a mutually beneficial gating network and a feature consistency loss. The gating network is able to control how much of each data augmentation is used for the representation within the network. The feature consistency loss, on the other hand, gives a constraint that augmented features from the same input should be in similar. In experiments, we demonstrate the effectiveness of the proposed method on the 12 largest time-series datasets from 2018 UCR Time Series Archive and reveal the relationships between the data augmentation methods through analysis of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2021

Adaptive Weighting Scheme for Automatic Time-Series Data Augmentation

Data augmentation methods have been shown to be a fundamental technique ...
research
10/29/2020

Self-paced Data Augmentation for Training Neural Networks

Data augmentation is widely used for machine learning; however, an effec...
research
05/25/2022

Augmentation-induced Consistency Regularization for Classification

Deep neural networks have become popular in many supervised learning tas...
research
02/22/2022

Improving Systematic Generalization Through Modularity and Augmentation

Systematic generalization is the ability to combine known parts into nov...
research
06/27/2023

Multi-perspective Information Fusion Res2Net with RandomSpecmix for Fake Speech Detection

In this paper, we propose the multi-perspective information fusion (MPIF...
research
10/10/2019

First Order Ambisonics Domain Spatial Augmentation for DNN-based Direction of Arrival Estimation

In this paper, we propose a novel data augmentation method for training ...
research
12/27/2022

MixupE: Understanding and Improving Mixup from Directional Derivative Perspective

Mixup is a popular data augmentation technique for training deep neural ...

Please sign up or login with your details

Forgot password? Click here to reset