As easy as APC: Leveraging self-supervised learning in the context of time series classification with varying levels of sparsity and severe class imbalance

06/29/2021
by   Fiorella Wever, et al.
5

High levels of sparsity and strong class imbalance are ubiquitous challenges that are often presented simultaneously in real-world time series data. While most methods tackle each problem separately, our proposed approach handles both in conjunction, while imposing fewer assumptions on the data. In this work, we propose leveraging a self-supervised learning method, specifically Autoregressive Predictive Coding (APC), to learn relevant hidden representations of time series data in the context of both missing data and class imbalance. We apply APC using either a GRU or GRU-D encoder on two real-world datasets, and show that applying one-step-ahead prediction with APC improves the classification results in all settings. In fact, by applying GRU-D - APC, we achieve state-of-the-art AUPRC results on the Physionet benchmark.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2023

Label-efficient Time Series Representation Learning: A Review

The scarcity of labeled data is one of the main challenges of applying d...
research
12/27/2021

Self-supervision of wearable sensors time-series data for influenza detection

Self-supervision may boost model performance in downstream tasks. Howeve...
research
08/25/2021

Learning From Long-Tailed Data With Noisy Labels

Class imbalance and noisy labels are the norm rather than the exception ...
research
04/24/2022

Large Scale Time-Series Representation Learning via Simultaneous Low and High Frequency Feature Bootstrapping

Learning representation from unlabeled time series data is a challenging...
research
10/29/2022

Self-supervised predictive coding and multimodal fusion advance patient deterioration prediction in fine-grained time resolution

In the Emergency Department (ED), accurate prediction of critical events...
research
05/01/2023

Self-supervised Activity Representation Learning with Incremental Data: An Empirical Study

In the context of mobile sensing environments, various sensors on mobile...

Please sign up or login with your details

Forgot password? Click here to reset