A Model for Learned Bloom Filters, and Optimizing by Sandwiching

01/03/2019
by   Michael Mitzenmacher, et al.
0

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to determine a function that models the data set the Bloom filter is meant to represent. Here we model such learned Bloom filters,, with the following outcomes: (1) we clarify what guarantees can and cannot be associated with such a structure; (2) we show how to estimate what size the learning function must obtain in order to obtain improved performance; (3) we provide a simple method, sandwiching, for optimizing learned Bloom filters; and (4) we propose a design and analysis approach for a learned Bloomier filter, based on our modeling approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2018

A Model for Learned Bloom Filters and Related Structures

Recent work has suggested enhancing Bloom filters by using a pre-filter,...
research
03/05/2018

Optimizing Learned Bloom Filters by Sandwiching

We provide a simple method for improving the performance of the recently...
research
02/26/2023

Autoencoders as Pattern Filters

We discuss a simple approach to transform autoencoders into "pattern fil...
research
06/23/2017

Further Study on GFR Features for JPEG Steganalysis

The GFR (Gabor Filter Residual) features, built as histograms of quantiz...
research
10/21/2019

Adaptive Learned Bloom Filter (Ada-BF): Efficient Utilization of the Classifier

Recent work suggests improving the performance of Bloom filter by incorp...
research
11/28/2022

A Critical Analysis of Classifier Selection in Learned Bloom Filters

Learned Bloom Filters, i.e., models induced from data via machine learni...
research
12/13/2021

On the Choice of General Purpose Classifiers in Learned Bloom Filters: An Initial Analysis Within Basic Filters

Bloom Filters are a fundamental and pervasive data structure. Within the...

Please sign up or login with your details

Forgot password? Click here to reset