Quantifying Quality of Class-Conditional Generative Models in Time-Series Domain

10/14/2022
by   Alireza Koochali, et al.
0

Generative models are designed to address the data scarcity problem. Even with the exploding amount of data, due to computational advancements, some applications (e.g., health care, weather forecast, fault detection) still suffer from data insufficiency, especially in the time-series domain. Thus generative models are essential and powerful tools, but they still lack a consensual approach for quality assessment. Such deficiency hinders the confident application of modern implicit generative models on time-series data. Inspired by assessment methods on the image domain, we introduce the InceptionTime Score (ITS) and the Frechet InceptionTime Distance (FITD) to gauge the qualitative performance of class conditional generative models on the time-series domain. We conduct extensive experiments on 80 different datasets to study the discriminative capabilities of proposed metrics alongside two existing evaluation metrics: Train on Synthetic Test on Real (TSTR) and Train on Real Test on Synthetic (TRTS). Extensive evaluation reveals that the proposed assessment method, i.e., ITS and FITD in combination with TSTR, can accurately assess class-conditional generative model performance.

READ FULL TEXT

page 12

page 15

research
01/20/2023

Regular Time-series Generation using SGM

Score-based generative models (SGMs) are generative models that are in t...
research
10/16/2022

Evaluation of the Synthetic Electronic Health Records

Generative models have been found effective for data synthesis due to th...
research
01/19/2022

Generative Models for Periodicity Detection in Noisy Signals

We introduce a new periodicity detection algorithm for binary time serie...
research
01/23/2023

ECGAN: Self-supervised generative adversarial network for electrocardiography

High-quality synthetic data can support the development of effective pre...
research
07/19/2023

Sig-Splines: universal approximation and convex calibration of time series generative models

We propose a novel generative model for multivariate discrete-time time ...
research
06/09/2022

Evaluating Aleatoric Uncertainty via Conditional Generative Models

Aleatoric uncertainty quantification seeks for distributional knowledge ...
research
09/07/2023

TSGBench: Time Series Generation Benchmark

Synthetic Time Series Generation (TSG) is crucial in a range of applicat...

Please sign up or login with your details

Forgot password? Click here to reset