DeepAI AI Chat
Log In Sign Up

AutoML Meets Time Series Regression Design and Analysis of the AutoSeries Challenge

by   Zhen Xu, et al.

Analyzing better time series with limited human effort is of interest to academia and industry. Driven by business scenarios, we organized the first Automated Time Series Regression challenge (AutoSeries) for the WSDM Cup 2020. We present its design, analysis, and post-hoc experiments. The code submission requirement precluded participants from any manual intervention, testing automated machine learning capabilities of solutions, across many datasets, under hardware and time limitations. We prepared 10 datasets from diverse application domains (sales, power consumption, air quality, traffic, and parking), featuring missing data, mixed continuous and categorical variables, and various sampling rates. Each dataset was split into a training and a test sequence (which was streamed, allowing models to continuously adapt). The setting of time series regression, differs from classical forecasting in that covariates at the present time are known. Great strides were made by participants to tackle this AutoSeries problem, as demonstrated by the jump in performance from the sample submission, and post-hoc comparisons with AutoGluon. Simple yet effective methods were used, based on feature engineering, LightGBM, and random search hyper-parameter tuning, addressing all aspects of the challenge. Our post-hoc analyses revealed that providing additional time did not yield significant improvements. The winners' code was open-sourced


page 5

page 6

page 10

page 11

page 13

page 21


Correlated daily time series and forecasting in the M4 competition

We participated in the M4 competition for time series forecasting and de...

Directed Time Series Regression for Control

We propose directed time series regression, a new approach to estimating...

A Unified Framework for Long Range and Cold Start Forecasting of Seasonal Profiles in Time Series

Providing long-range forecasts is a fundamental challenge in time series...

Time Series Regression

This paper introduces Time Series Regression (TSR): a little-studied tas...

Seasonally-Adjusted Auto-Regression of Vector Time Series

We present a simple algorithm to forecast vector time series, that is ro...

Chaos as an interpretable benchmark for forecasting and data-driven modelling

The striking fractal geometry of strange attractors underscores the gene...

Code Repositories


This is the official repo for AutoML Meets Time Series Regression: Design and Analysis of the AutoSeries Challenge (ECMLPKDD21) materials.

view repo