Baseline Drift Estimation for Air Quality Data Using Quantile Trend Filtering

04/24/2019
by   Halley L. Brantley, et al.
0

We address the problem of estimating smoothly varying baseline trends in time series data. This problem arises in a wide range of fields, including chemistry, macroeconomics, and medicine; however, our study is motivated by the analysis of data from low cost air quality sensors. Our methods extend the quantile trend filtering framework to enable the estimation of multiple quantile trends simultaneously while ensuring that the quantiles do not cross. To handle the computational challenge posed by very long time series, we propose a parallelizable alternating direction method of moments (ADMM) algorithm. The ADMM algorthim enables the estimation of trends in a piecewise manner, both reducing the computation time and extending the limits of the method to larger data sizes. We also address smoothing parameter selection and propose a modified criterion based on the extended Bayesian Information Criterion. Through simulation studies and our motivating application to low cost air quality sensor data, we demonstrate that our model provides better quantile trend estimates than existing methods and improves signal classification of low-cost air quality sensor output.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2022

Bayesian Quantile Trend Filtering on Graphs using Shrinkage Priors

Quantiles are useful characteristics of random variables that can provid...
research
08/28/2019

Low Cost Sensor Networks; How Do We Know the Data are Reliable?

Plausibility of data from networks of low-cost measurement devices is a ...
research
05/20/2022

Trend analysis and forecasting air pollution in Rwanda

Air pollution is a major public health problem worldwide although the la...
research
03/14/2023

Optimal Sampling Designs for Multi-dimensional Streaming Time Series with Application to Power Grid Sensor Data

The Internet of Things (IoT) system generates massive high-speed tempora...
research
10/23/2019

Wasserstein total variation filtering

In this paper, we expand upon the theory of trend filtering by introduci...
research
02/15/2019

Quantile double autoregression

Many financial time series have varying structures at different quantile...
research
02/20/2018

Nanosecond-precision Time-of-Arrival Estimation for Aircraft Signals with low-cost SDR Receivers

Precise Time-of-Arrival (TOA) estimations of aircraft and drone signals ...

Please sign up or login with your details

Forgot password? Click here to reset