Time Series Forecasting with Hypernetworks Generating Parameters in Advance

11/22/2022
by   Jaehoon Lee, et al.
0

Forecasting future outcomes from recent time series data is not easy, especially when the future data are different from the past (i.e. time series are under temporal drifts). Existing approaches show limited performances under data drifts, and we identify the main reason: It takes time for a model to collect sufficient training data and adjust its parameters for complicated temporal patterns whenever the underlying dynamics change. To address this issue, we study a new approach; instead of adjusting model parameters (by continuously re-training a model on new data), we build a hypernetwork that generates other target models' parameters expected to perform well on the future data. Therefore, we can adjust the model parameters beforehand (if the hypernetwork is correct). We conduct extensive experiments with 6 target models, 6 baselines, and 4 datasets, and show that our HyperGPA outperforms other baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/30/2020

Few-shot Learning for Time-series Forecasting

Time-series forecasting is important for many applications. Forecasting ...
research
01/28/2021

Adjusting for Autocorrelated Errors in Neural Networks for Time Series Regression and Forecasting

In many cases, it is difficult to generate highly accurate models for ti...
research
04/07/2022

Few-Shot Forecasting of Time-Series with Heterogeneous Channels

Learning complex time series forecasting models usually requires a large...
research
10/25/2022

WaveBound: Dynamic Error Bounds for Stable Time Series Forecasting

Time series forecasting has become a critical task due to its high pract...
research
08/15/2021

Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Time

In several real world applications, machine learning models are deployed...
research
03/19/2022

When regression coefficients change over time: A proposal

A common approach in forecasting problems is to estimate a least-squares...
research
02/27/2023

Deep Imbalanced Time-series Forecasting via Local Discrepancy Density

Time-series forecasting models often encounter abrupt changes in a given...

Please sign up or login with your details

Forgot password? Click here to reset