DeepAI AI Chat
Log In Sign Up

A tale of two toolkits, report the first: benchmarking time series classification algorithms for correctness and efficiency

by   Anthony Bagnall, et al.

sktime is an open source, Python based, sklearn compatible toolkit for time series analysis developed by researchers at the University of East Anglia, University College London and the Alan Turing Institute. A key initial goal for sktime was to provide time series classification functionality equivalent to that available in a related java package, tsml. We describe the implementation of six such classifiers in sktime and compare them to their tsml equivalents. We demonstrate correctness through equivalence of accuracy on a range of standard test problems and compare the build time of the different implementations. We find that there is significant difference in accuracy on only one of the six algorithms, and this difference was to be expected. We found a much wider range of difference in efficiency. Again, this was not unexpected, but it does highlight ways both toolkits could be improved.


page 1

page 2

page 3

page 4


Monash University, UEA, UCR Time Series Regression Archive

Time series research has gathered lots of interests in the last decade, ...

Seglearn: A Python Package for Learning Sequences and Time Series

Seglearn is an open-source python package for machine learning time seri...

The UEA multivariate time series classification archive, 2018

In 2002, the UCR time series classification archive was first released w...

StateSpaceModels.jl: a Julia Package for Time-Series Analysis in a State-Space Framework

StateSpaceModels.jl is an open-source Julia package for modeling, foreca...

Plotly-Resampler: Effective Visual Analytics for Large Time Series

Visual analytics is arguably the most important step in getting acquaint...

Benchmarking optimality of time series classification methods in distinguishing diffusions

Performance benchmarking is a crucial component of time series classific...

Simulated Data Experiments for Time Series Classification Part 1: Accuracy Comparison with Default Settings

There are now a broad range of time series classification (TSC) algorith...