Depth-based Outlier Detection for Grouped Smart Meters: a Functional Data Analysis Toolbox

07/02/2021
by   A. Elías, et al.
0

Smart metering infrastructures collect data almost continuously in the form of fine-grained long time series. These massive time series often have common daily patterns that are repeated between similar days or seasons and shared between grouped meters. Within this context, we propose a method to highlight individuals with abnormal daily dependency patterns, which we term evolution outliers. To this end, we approach the problem from the standpoint of Functional Data Analysis (FDA), by treating each daily record as a function or curve. We then focus on the morphological aspects of the observed curves, such as daily magnitude, daily shape, derivatives, and inter-day evolution. The proposed method for evolution outliers relies on the concept of functional depth, which has been a cornerstone in the literature of FDA to build shape and magnitude outlier detection methods. In conjunction with our evolution outlier proposal, these methods provide an outlier detection toolbox for smart meter data that covers a wide palette of functional outliers classes. We illustrate the outlier identification ability of this toolbox using actual smart metering data corresponding to photovoltaic energy generation and circuit voltage records.

READ FULL TEXT

page 1

page 2

page 6

research
05/11/2021

Outlier Detection for Functional Data with R Package fdaoutlier

Outlier detection is one of the standard exploratory analysis tasks in f...
research
10/02/2021

Functional outlier detection for density-valued data with application to robustify distribution to distribution regression

Distributional data analysis, concerned with statistical analysis and mo...
research
11/26/2020

A Visual Analytics Approach to Monitor Time-Series Data with Incremental and Progressive Functional Data Analysis

Many real-world applications involve analyzing time-dependent phenomena,...
research
08/16/2018

Functional Outlier Detection and Taxonomy by Sequential Transformations

Functional data analysis can be seriously impaired by abnormal observati...
research
12/16/2019

Detecting and Classifying Outliers in Big Functional Data

This paper proposes two new outlier detection methods, which are useful ...
research
04/14/2023

Smart Metro: Deep Learning Approaches to Forecasting the MRT Line 3 Ridership

Since its establishment in 1999, the Metro Rail Transit Line 3 (MRT3) ha...
research
01/05/2020

Data Curves Clustering Using Common Patterns Detection

For the past decades we have experienced an enormous expansion of the ac...

Please sign up or login with your details

Forgot password? Click here to reset