Differentiable Divergences Between Time Series

10/16/2020
by   Mathieu Blondel, et al.
0

Computing the discrepancy between time series of variable sizes is notoriously challenging. While dynamic time warping (DTW) is popularly used for this purpose, it is not differentiable everywhere and is known to lead to bad local optima when used as a "loss". Soft-DTW addresses these issues, but it is not a positive definite divergence: due to the bias introduced by entropic regularization, it can be negative and it is not minimized when the time series are equal. We propose in this paper a new divergence, dubbed soft-DTW divergence, which aims to correct these issues. We study its properties; in particular, under conditions on the ground cost, we show that it is non-negative and minimized when the time series are equal. We also propose a new "sharp" variant by further removing entropic bias. We showcase our divergences on time series averaging and demonstrate significant accuracy improvements compared to both DTW and soft-DTW on 84 time series classification datasets.

READ FULL TEXT

page 20

page 21

research
03/05/2017

Soft-DTW: a Differentiable Loss Function for Time-Series

We propose in this paper a differentiable learning loss between time ser...
research
06/22/2020

Aligning Time Series on Incomparable Spaces

Dynamic time warping (DTW) is a useful method for aligning, comparing an...
research
03/19/2023

Deep Declarative Dynamic Time Warping for End-to-End Learning of Alignment Paths

This paper addresses learning end-to-end models for time series data tha...
research
02/16/2018

Pattern Localization in Time Series through Signal-To-Model Alignment in Latent Space

In this paper, we study the problem of locating a predefined sequence of...
research
09/26/2019

Data Smashing 2.0: Sequence Likelihood (SL) Divergence For Fast Time Series Comparison

Recognizing subtle historical patterns is central to modeling and foreca...
research
08/10/2023

Stabilizing Training with Soft Dynamic Time Warping: A Case Study for Pitch Class Estimation with Weakly Aligned Targets

Soft dynamic time warping (SDTW) is a differentiable loss function that ...
research
11/29/2018

Recurrent Deep Divergence-based Clustering for simultaneous feature learning and clustering of variable length time series

The task of clustering unlabeled time series and sequences entails a par...

Please sign up or login with your details

Forgot password? Click here to reset