AutoML Meets Time Series Regression Design and Analysis of the AutoSeries Challenge

07/28/2021
by   Zhen Xu, et al.
6

Analyzing better time series with limited human effort is of interest to academia and industry. Driven by business scenarios, we organized the first Automated Time Series Regression challenge (AutoSeries) for the WSDM Cup 2020. We present its design, analysis, and post-hoc experiments. The code submission requirement precluded participants from any manual intervention, testing automated machine learning capabilities of solutions, across many datasets, under hardware and time limitations. We prepared 10 datasets from diverse application domains (sales, power consumption, air quality, traffic, and parking), featuring missing data, mixed continuous and categorical variables, and various sampling rates. Each dataset was split into a training and a test sequence (which was streamed, allowing models to continuously adapt). The setting of time series regression, differs from classical forecasting in that covariates at the present time are known. Great strides were made by participants to tackle this AutoSeries problem, as demonstrated by the jump in performance from the sample submission, and post-hoc comparisons with AutoGluon. Simple yet effective methods were used, based on feature engineering, LightGBM, and random search hyper-parameter tuning, addressing all aspects of the challenge. Our post-hoc analyses revealed that providing additional time did not yield significant improvements. The winners' code was open-sourced https://www.4paradigm.com/competition/autoseries2020.

READ FULL TEXT

page 5

page 6

page 10

page 11

page 13

page 21

research
03/28/2020

Correlated daily time series and forecasting in the M4 competition

We participated in the M4 competition for time series forecasting and de...
research
06/26/2012

Directed Time Series Regression for Control

We propose directed time series regression, a new approach to estimating...
research
10/23/2017

A Unified Framework for Long Range and Cold Start Forecasting of Seasonal Profiles in Time Series

Providing long-range forecasts is a fundamental challenge in time series...
research
02/10/2021

Self-supervised learning for fast and scalable time series hyper-parameter tuning

Hyper-parameters of time series models play an important role in time se...
research
06/23/2020

Time Series Regression

This paper introduces Time Series Regression (TSR): a little-studied tas...
research
02/20/2021

nTreeClus: a Tree-based Sequence Encoder for Clustering Categorical Series

The overwhelming presence of categorical/sequential data in diverse doma...
research
10/11/2021

Chaos as an interpretable benchmark for forecasting and data-driven modelling

The striking fractal geometry of strange attractors underscores the gene...

Please sign up or login with your details

Forgot password? Click here to reset