A Non-linear Function-on-Function Model for Regression with Time Series Data

11/24/2020
by   Qiyao Wang, et al.
0

In the last few decades, building regression models for non-scalar variables, including time series, text, image, and video, has attracted increasing interests of researchers from the data analytic community. In this paper, we focus on a multivariate time series regression problem. Specifically, we aim to learn mathematical mappings from multiple chronologically measured numerical variables within a certain time interval S to multiple numerical variables of interest over time interval T. Prior arts, including the multivariate regression model, the Seq2Seq model, and the functional linear models, suffer from several limitations. The first two types of models can only handle regularly observed time series. Besides, the conventional multivariate regression models tend to be biased and inefficient, as they are incapable of encoding the temporal dependencies among observations from the same time series. The sequential learning models explicitly use the same set of parameters along time, which has negative impacts on accuracy. The function-on-function linear model in functional data analysis (a branch of statistics) is insufficient to capture complex correlations among the considered time series and suffer from underfitting easily. In this paper, we propose a general functional mapping that embraces the function-on-function linear model as a special case. We then propose a non-linear function-on-function model using the fully connected neural network to learn the mapping from data, which addresses the aforementioned concerns in the existing approaches. For the proposed model, we describe in detail the corresponding numerical implementation procedures. The effectiveness of the proposed model is demonstrated through the application to two real-world problems.

READ FULL TEXT

page 1

page 7

research
01/01/2023

A Functional approach for Two Way Dimension Reduction in Time Series

The rise in data has led to the need for dimension reduction techniques,...
research
09/11/2020

Spatio-Temporal Functional Neural Networks

Explosive growth in spatio-temporal data and its wide range of applicati...
research
03/16/2021

Deep Time Series Models for Scarce Data

Time series data have grown at an explosive rate in numerous domains and...
research
08/29/2023

The projected dynamic linear model for time series on the sphere

Time series on the unit n-sphere arise in directional statistics, compos...
research
03/27/2019

Introduction to Dynamic Linear Models for Time Series Analysis

Dynamic linear models (DLM) offer a very generic framework to analyse ti...
research
02/27/2020

Prediction of adverse events in Afghanistan: regression analysis of time series data grouped not by geographic dependencies

The aim of this study was to approach a difficult regression task on hig...
research
07/12/2022

Wasserstein multivariate auto-regressive models for modeling distributional time series and its application in graph learning

We propose a new auto-regressive model for the statistical analysis of m...

Please sign up or login with your details

Forgot password? Click here to reset