hSPICE: State-Aware Event Shedding in Complex Event Processing

06/15/2020
by   Ahmad Slo, et al.
0

In complex event processing (CEP), load shedding is performed to maintain a given latency bound during overload situations when there is a limitation on resources. However, shedding load implies degradation in the quality of results (QoR). Therefore, it is crucial to perform load shedding in a way that has the lowest impact on QoR. Researchers, in the CEP domain, propose to drop either events or partial matches (PMs) in overload cases. They assign utilities to events or PMs by considering either the importance of events or the importance of PMs but not both together. In this paper, we propose a load shedding approach for CEP systems that combines these approaches by assigning a utility to an event by considering both the event importance and the importance of PMs. We adopt a probabilistic model that uses the type and position of an event in a window and the state of a PM to assign a utility to an event corresponding to each PM. We, also, propose an approach to predict a utility threshold that is used to drop the required amount of events to maintain a given latency bound. By extensive evaluations on two real-world datasets and several representative queries, we show that, in the majority of cases, our load shedding approach outperforms state-of-the-art load shedding approaches, w.r.t. QoR.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2020

pSPICE: Partial Match Shedding for Complex Event Processing

Complex event processing (CEP) systems continuously process input event ...
research
02/14/2020

eSPICE: Probabilistic Load Shedding from Input Event Streams in Complex Event Processing

Complex event processing systems process the input event streams on-the-...
research
07/05/2022

A general framework to quantify the event importance in multi-event contests

We propose a statistical framework for quantifying the importance of sin...
research
07/05/2023

Utility-Aware Load Shedding for Real-time Video Analytics at the Edge

Real-time video analytics typically require video frames to be processed...
research
03/06/2013

A Bayesian Variant of Shafer's Commonalities For Modelling Unforeseen Events

Shafer's theory of belief and the Bayesian theory of probability are two...
research
09/07/2020

A Hybrid Neuro-Symbolic Approach for Complex Event Processing

Training a model to detect patterns of interrelated events that form sit...
research
09/13/2021

Learning Constraints and Descriptive Segmentation for Subevent Detection

Event mentions in text correspond to real-world events of varying degree...

Please sign up or login with your details

Forgot password? Click here to reset