Utilizing Expert Features for Contrastive Learning of Time-Series Representations

06/23/2022
by   Manuel Nonnenmacher, et al.
0

We present an approach that incorporates expert knowledge for time-series representation learning. Our method employs expert features to replace the commonly used data transformations in previous contrastive learning approaches. We do this since time-series data frequently stems from the industrial or medical field where expert features are often available from domain experts, while transformations are generally elusive for time-series data. We start by proposing two properties that useful time-series representations should fulfill and show that current representation learning approaches do not ensure these properties. We therefore devise ExpCLR, a novel contrastive learning approach built on an objective that utilizes expert features to encourage both properties for the learned representation. Finally, we demonstrate on three real-world time-series datasets that ExpCLR surpasses several state-of-the-art methods for both unsupervised and semi-supervised representation learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/03/2023

Unsupervised Representation Learning for Time Series: A Review

Unsupervised representation learning approaches aim to learn discriminat...
research
08/02/2023

Enhancing Representation Learning for Periodic Time Series with Floss: A Frequency Domain Regularization Approach

Time series analysis is a fundamental task in various application domain...
research
04/02/2023

Constructive Assimilation: Boosting Contrastive Learning Performance through View Generation Strategies

Transformations based on domain expertise (expert transformations), such...
research
03/17/2022

Mixing Up Contrastive Learning: Self-Supervised Representation Learning for Time Series

The lack of labeled data is a key challenge for learning useful represen...
research
03/21/2023

Time Series Contrastive Learning with Information-Aware Augmentations

Various contrastive learning approaches have been proposed in recent yea...
research
04/24/2022

Large Scale Time-Series Representation Learning via Simultaneous Low and High Frequency Feature Bootstrapping

Learning representation from unlabeled time series data is a challenging...
research
08/24/2023

A Co-training Approach for Noisy Time Series Learning

In this work, we focus on robust time series representation learning. Ou...

Please sign up or login with your details

Forgot password? Click here to reset