Self-supervised learning for fast and scalable time series hyper-parameter tuning

02/10/2021
by   Peiyi Zhang, et al.
7

Hyper-parameters of time series models play an important role in time series analysis. Slight differences in hyper-parameters might lead to very different forecast results for a given model, and therefore, selecting good hyper-parameter values is indispensable. Most of the existing generic hyper-parameter tuning methods, such as Grid Search, Random Search, Bayesian Optimal Search, are based on one key component - search, and thus they are computationally expensive and cannot be applied to fast and scalable time-series hyper-parameter tuning (HPT). We propose a self-supervised learning framework for HPT (SSL-HPT), which uses time series features as inputs and produces optimal hyper-parameters. SSL-HPT algorithm is 6-20x faster at getting hyper-parameters compared to other search based algorithms while producing comparable accurate forecasting results in various applications.

READ FULL TEXT

page 3

page 5

research
06/03/2020

Automatic Setting of DNN Hyper-Parameters by Mixing Bayesian Optimization and Tuning Rules

Deep learning techniques play an increasingly important role in industri...
research
04/13/2021

Bayesian Optimisation for a Biologically Inspired Population Neural Network

We have used Bayesian Optimisation (BO) to find hyper-parameters in an e...
research
11/04/2019

Seasonally-Adjusted Auto-Regression of Vector Time Series

We present a simple algorithm to forecast vector time series, that is ro...
research
03/12/2020

Analysis of Hyper-Parameters for Small Games: Iterations or Epochs in Self-Play?

The landmark achievements of AlphaGo Zero have created great research in...
research
03/19/2019

Hyper-Parameter Sweep on AlphaZero General

Since AlphaGo and AlphaGo Zero have achieved breakground successes in th...
research
03/27/2019

Echo State Networks with Self-Normalizing Activations on the Hyper-Sphere

Among the various architectures of Recurrent Neural Networks, Echo State...
research
07/28/2021

AutoML Meets Time Series Regression Design and Analysis of the AutoSeries Challenge

Analyzing better time series with limited human effort is of interest to...

Please sign up or login with your details

Forgot password? Click here to reset