Efficient Automated Deep Learning for Time Series Forecasting

05/11/2022
by   Difan Deng, et al.
12

Recent years have witnessed tremendously improved efficiency of Automated Machine Learning (AutoML), especially Automated Deep Learning (AutoDL) systems, but recent work focuses on tabular, image, or NLP tasks. So far, little attention has been paid to general AutoDL frameworks for time series forecasting, despite the enormous success in applying different novel architectures to such tasks. In this paper, we propose an efficient approach for the joint optimization of neural architecture and hyperparameters of the entire data processing pipeline for time series forecasting. In contrast to common NAS search spaces, we designed a novel neural architecture search space covering various state-of-the-art architectures, allowing for an efficient macro-search over different DL approaches. To efficiently search in such a large configuration space, we use Bayesian optimization with multi-fidelity optimization. We empirically study several different budget types enabling efficient multi-fidelity optimization on different forecasting datasets. Furthermore, we compared our resulting system, dubbed Auto-PyTorch-TS, against several established baselines and show that it significantly outperforms all of them across several datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/25/2022

An Intelligent End-to-End Neural Architecture Search Framework for Electricity Forecasting Model Development

Recent years have witnessed an exponential growth in developing deep lea...
06/24/2020

Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL

While early AutoML frameworks focused on optimizing traditional ML pipel...
03/26/2022

AutoTS: Automatic Time Series Forecasting Model Design Based on Two-Stage Pruning

Automatic Time Series Forecasting (TSF) model design which aims to help ...
07/18/2018

Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search

While existing work on neural architecture search (NAS) tunes hyperparam...
03/27/2020

Deep-n-Cheap: An Automated Search Framework for Low Complexity Deep Learning

We present Deep-n-Cheap – an open-source AutoML framework to search for ...
02/27/2022

ONE-NAS: An Online NeuroEvolution based Neural Architecture Search for Time Series Forecasting

Time series forecasting (TSF) is one of the most important tasks in data...
12/21/2021

AutoCTS: Automated Correlated Time Series Forecasting – Extended Version

Correlated time series (CTS) forecasting plays an essential role in many...