Failure Probability Analysis for Partial Extraction from Invertible Bloom Filters

08/03/2020
by   Ivo Kubjas, et al.
0

Invertible Bloom Filter (IBF) is a data structure, which employs a small set of hash functions. An IBF allows for an efficient insertion and, with high probability, for an efficient extraction of the data. However, the success probability of the extraction depends on the storage overhead of an IBF and the amount of the data stored. In an application, such as set reconciliation, where there is a need to extract data stored in the IBF, the extraction might succeed only partially, by recovering only part of the stored data. In this work, the probability of success for a partial extraction of data from an IBF is analyzed. It is shown that partial extraction could be useful in applications, such as set reconciliation. In particular, it allows for set reconciliation by using the IBF, where the storage overhead is too small to allow full extraction. An upper bound on the number of rounds in an iterative set reconciliation protocol is presented. The numerical results are derived analytically, and confirmed by the computer simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2020

Succinct Filters for Sets of Unknown Sizes

The membership problem asks to maintain a set S⊆[u], supporting insertio...
research
07/17/2023

Optimal storage codes on graphs with fixed locality

Storage codes on graphs are an instance of codes with locality, which ar...
research
02/11/2019

CPOI: A Compact Method to Archive Versioned RDF Triple-Sets

Large amounts of RDF/S data are produced and published lately, and sever...
research
11/10/2021

Functional Broadcast Repair of Multiple Partial Failures in Wireless Distributed Storage Systems

We consider a distributed storage system with n nodes, where a user can ...
research
12/28/2022

Invertible Bloom Lookup Tables with Listing Guarantees

The Invertible Bloom Lookup Table (IBLT) is a probabilistic concise data...
research
01/24/2019

SimFS: A Simulation Data Virtualizing File System Interface

Nowadays simulations can produce petabytes of data to be stored in paral...
research
02/11/2018

Binary Pebbling Algorithms for In-Place Reversal of One-Way Hash Chains

We present optimal binary pebbling algorithms for in-place reversal (bac...

Please sign up or login with your details

Forgot password? Click here to reset