Can the Multi-Incoming Smart Meter Compressed Streams be Re-Compressed?

06/05/2020
by   Sharif Abuadbba, et al.
0

Smart meters have currently attracted attention because of their high efficiency and throughput performance. They transmit a massive volume of continuously collected waveform readings (e.g. monitoring). Although many compression models are proposed, the unexpected size of these compressed streams required endless storage and management space which poses a unique challenge. Therefore, this paper explores the question of can the compressed smart meter readings be re-compressed? We first investigate the applicability of re-applying general compression algorithms directly on compressed streams. The results were poor due to the lack of redundancy. We further propose a novel technique to enhance the theoretical entropy and exploit that to re-compress. This is successfully achieved by using unsupervised learning as a similarity measurement to cluster the compressed streams into subgroups. The streams in every subgroup have been interleaved, followed by the first derivative to minimize the values and increase the redundancy. After that, two rotation steps have been applied to rearrange the readings in a more consecutive format before applying a developed dynamic run length. Finally, entropy coding is performed. Both mathematical and empirical experiments proved the significant improvement of the compressed streams entropy (i.e. almost reduced by half) and the resultant compression ratio (i.e. up to 50

READ FULL TEXT
research
05/28/2019

HEDGE: Efficient Traffic Classification of Encrypted and Compressed Packets

As the size and source of network traffic increase, so does the challeng...
research
08/24/2022

Learned Lossless JPEG Transcoding via Joint Lossy and Residual Compression

As a commonly-used image compression format, JPEG has been broadly appli...
research
11/19/2012

Five Modulus Method For Image Compression

Data is compressed by reducing its redundancy, but this also makes the d...
research
03/28/2022

Improving Matrix-vector Multiplication via Lossless Grammar-Compressed Matrices

As nowadays Machine Learning (ML) techniques are generating huge data co...
research
07/13/2020

Local Editing in LZ-End Compressed Data

This paper presents an algorithm for the modification of data compressed...
research
02/26/2023

Data-Efficient Sequence-Based Visual Place Recognition with Highly Compressed JPEG Images

Visual Place Recognition (VPR) is a fundamental task that allows a robot...
research
12/03/2017

ALLSAT compressed with wildcards. Part 4: An invitation for C-programmers

The model set of a general Boolean function in CNF is calculated in a co...

Please sign up or login with your details

Forgot password? Click here to reset