SimTS: Rethinking Contrastive Representation Learning for Time Series Forecasting

03/31/2023
by   Xiaochen Zheng, et al.
0

Contrastive learning methods have shown an impressive ability to learn meaningful representations for image or time series classification. However, these methods are less effective for time series forecasting, as optimization of instance discrimination is not directly applicable to predicting the future state from the history context. Moreover, the construction of positive and negative pairs in current technologies strongly relies on specific time series characteristics, restricting their generalization across diverse types of time series data. To address these limitations, we propose SimTS, a simple representation learning approach for improving time series forecasting by learning to predict the future from the past in the latent space. SimTS does not rely on negative pairs or specific assumptions about the characteristics of the particular time series. Our extensive experiments on several benchmark time series forecasting datasets show that SimTS achieves competitive performance compared to existing contrastive learning methods. Furthermore, we show the shortcomings of the current contrastive learning framework used for time series forecasting through a detailed ablation study. Overall, our work suggests that SimTS is a promising alternative to other contrastive learning approaches for time series forecasting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2023

Time Series Contrastive Learning with Information-Aware Augmentations

Various contrastive learning approaches have been proposed in recent yea...
research
02/03/2022

CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecasting

Deep learning has been actively studied for time series forecasting, and...
research
02/07/2023

Towards Better Time Series Contrastive Learning: A Dynamic Bad Pair Mining Approach

Not all positive pairs are beneficial to time series contrastive learnin...
research
12/21/2020

Social NCE: Contrastive Learning of Socially-aware Motion Representations

Learning socially-aware motion representations is at the core of recent ...
research
06/09/2021

Neighborhood Contrastive Learning Applied to Online Patient Monitoring

Intensive care units (ICU) are increasingly looking towards machine lear...
research
05/08/2023

Explainable Parallel RCNN with Novel Feature Representation for Time Series Forecasting

Accurate time series forecasting is a fundamental challenge in data scie...
research
02/18/2020

Conditional Mutual information-based Contrastive Loss for Financial Time Series Forecasting

We present a method for financial time series forecasting using represen...

Please sign up or login with your details

Forgot password? Click here to reset