LEAVES: Learning Views for Time-Series Data in Contrastive Learning

10/13/2022
by   Han Yu, et al.
0

Contrastive learning, a self-supervised learning method that can learn representations from unlabeled data, has been developed promisingly. Many methods of contrastive learning depend on data augmentation techniques, which generate different views from the original signal. However, tuning policies and hyper-parameters for more effective data augmentation methods in contrastive learning is often time and resource-consuming. Researchers have designed approaches to automatically generate new views for some input signals, especially on the image data. But the view-learning method is not well developed for time-series data. In this work, we propose a simple but effective module for automating view generation for time-series data in contrastive learning, named learning views for time-series data (LEAVES). The proposed module learns the hyper-parameters for augmentations using adversarial training in contrastive learning. We validate the effectiveness of the proposed method using multiple time-series datasets. The experiments demonstrate that the proposed method is more effective in finding reasonable views and performs downstream tasks better than the baselines, including manually tuned augmentation-based contrastive learning methods and SOTA methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/13/2022

Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification

Learning time-series representations when only unlabeled data or few lab...
research
06/09/2021

Neighborhood Contrastive Learning Applied to Online Patient Monitoring

Intensive care units (ICU) are increasingly looking towards machine lear...
research
08/24/2023

A Co-training Approach for Noisy Time Series Learning

In this work, we focus on robust time series representation learning. Ou...
research
07/13/2023

Multi-view self-supervised learning for multivariate variable-channel time series

Labeling of multivariate biomedical time series data is a laborious and ...
research
04/24/2022

Large Scale Time-Series Representation Learning via Simultaneous Low and High Frequency Feature Bootstrapping

Learning representation from unlabeled time series data is a challenging...
research
09/11/2023

Graph Contextual Contrasting for Multivariate Time Series Classification

Contrastive learning, as a self-supervised learning paradigm, becomes po...
research
01/27/2023

Leveraging the Third Dimension in Contrastive Learning

Self-Supervised Learning (SSL) methods operate on unlabeled data to lear...

Please sign up or login with your details

Forgot password? Click here to reset