DeepAI AI Chat
Log In Sign Up

Tabular Transformers for Modeling Multivariate Time Series

11/03/2020
by   Inkit Padhi, et al.
0

Tabular datasets are ubiquitous in data science applications. Given their importance, it seems natural to apply state-of-the-art deep learning algorithms in order to fully unlock their potential. Here we propose neural network models that represent tabular time series that can optionally leverage their hierarchical structure. This results in two architectures for tabular time series: one for learning representations that is analogous to BERT and can be pre-trained end-to-end and used in downstream tasks, and one that is akin to GPT and can be used for generation of realistic synthetic tabular sequences. We demonstrate our models on two datasets: a synthetic credit card transaction dataset, where the learned representations are used for fraud detection and synthetic data generation, and on a real pollution dataset, where the learned encodings are used to predict atmospheric pollutant concentrations. Code and data are available at https://github.com/IBM/TabFormer.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/05/2021

Attention Augmented Convolutional Transformer for Tabular Time-series

Time-series classification is one of the most frequently performed tasks...
08/04/2022

Customs Import Declaration Datasets

Given the huge volume of cross-border flows, effective and efficient con...
05/30/2020

Learning Efficient Representations of Mouse Movements to Predict User Attention

Tracking mouse cursor movements can be used to predict user attention on...
06/19/2021

Learning Timestamp-Level Representations for Time Series with Hierarchical Contrastive Loss

This paper presents TS2Vec, a universal framework for learning timestamp...
05/23/2022

Time-series Transformer Generative Adversarial Networks

Many real-world tasks are plagued by limitations on data: in some instan...
11/01/2019

LFZip: Lossy compression of multivariate floating-point time series data via improved prediction

Time series data compression is emerging as an important problem with th...
05/27/2022

Group GAN

Generating multivariate time series is a promising approach for sharing ...

Code Repositories

TabFormer

Code & Data for "Tabular Transformers for Modeling Multivariate Time Series"


view repo