A dynamic factor model approach to incorporate Big Data in state space models for official statistics

01/31/2019
by   Caterina Schiavoni, et al.
0

In this paper we consider estimation of unobserved components in state space models using a dynamic factor approach to incorporate auxiliary information from high-dimensional data sources. We apply the methodology to unemployment estimation as done by Statistics Netherlands, who uses a multivariate state space model to produce monthly figures for the unemployment using series observed with the labour force survey (LFS). We extend the model by including auxiliary series about job search behaviour from Google Trends and claimant counts, partially observed at higher frequencies. Our factor model allows for nowcasting the variable of interest, providing reliable unemployment estimates in real time before LFS data become available.

READ FULL TEXT
research
02/07/2023

High-Dimensional Conditionally Gaussian State Space Models with Missing Data

We develop an efficient sampling approach for handling complex missing d...
research
07/23/2020

Deep Dynamic Factor Models

We propose a novel deep neural net framework - that we refer to as Deep ...
research
01/29/2023

Multidimensional dynamic factor models

This paper generalises dynamic factor models for multidimensional depend...
research
06/02/2023

An OPC UA-based industrial Big Data architecture

Industry 4.0 factories are complex and data-driven. Data is yielded from...
research
02/07/2023

Including connecting elements into the Lagrange multiplier state-space substructuring formulation

This paper extends the inverse substructuring (IS) approach to the state...
research
08/02/2022

A Recursive Partitioning Approach for Dynamic Discrete Choice Modeling in High Dimensional Settings

Dynamic discrete choice models are widely employed to answer substantive...
research
04/10/2020

Robust Estimation for Discrete-Time State Space Models

State space models (SSMs) are now ubiquitous in many fields and increasi...

Please sign up or login with your details

Forgot password? Click here to reset