CADDA: Class-wise Automatic Differentiable Data Augmentation for EEG Signals

06/25/2021
by   Cédric Rommel, et al.
0

Data augmentation is a key element of deep learning pipelines, as it informs the network during training about transformations of the input data that keep the label unchanged. Manually finding adequate augmentation methods and parameters for a given pipeline is however rapidly cumbersome. In particular, while intuition can guide this decision for images, the design and choice of augmentation policies remains unclear for more complex types of data, such as neuroscience signals. Moreover, label independent strategies might not be suitable for such structured data and class-dependent augmentations might be necessary. This idea has been surprisingly unexplored in the literature, while it is quite intuitive: changing the color of a car image does not change the object class to be predicted, but doing the same to the picture of an orange does. This paper aims to increase the generalization power added through class-wise data augmentation. Yet, as seeking transformations depending on the class largely increases the complexity of the task, using gradient-free optimization techniques as done by most existing automatic approaches becomes intractable for real-world datasets. For this reason we propose to use differentiable data augmentation amenable to gradient-based learning. EEG signals are a perfect example of data for which good augmentation policies are mostly unknown. In this work, we demonstrate the relevance of our approach on the clinically relevant sleep staging classification task, for which we also propose differentiable transformations.

READ FULL TEXT

page 17

page 18

page 19

research
06/29/2022

Data augmentation for learning predictive models on EEG: a systematic comparison

The use of deep learning for electroencephalography (EEG) classification...
research
02/04/2022

Deep invariant networks with differentiable augmentation layers

Designing learning systems which are invariant to certain data transform...
research
10/09/2015

Dreaming More Data: Class-dependent Distributions over Diffeomorphisms for Learned Data Augmentation

Data augmentation is a key element in training high-dimensional models. ...
research
11/19/2020

Differentiable Data Augmentation with Kornia

In this paper we present a review of the Kornia differentiable data augm...
research
02/22/2022

Invariance Learning in Deep Neural Networks with Differentiable Laplace Approximations

Data augmentation is commonly applied to improve performance of deep lea...
research
12/17/2021

DNA: Dynamic Network Augmentation

In many classification problems, we want a classifier that is robust to ...
research
05/17/2020

FuCiTNet: Improving the generalization of deep learning networks by the fusion of learned class-inherent transformations

It is widely known that very small datasets produce overfitting in Deep ...

Please sign up or login with your details

Forgot password? Click here to reset