Performance Model for Similarity Caching

09/21/2023
by   Younes Ben Mazziane, et al.
0

Similarity caching allows requests for an item to be served by a similar item. Applications include recommendation systems, multimedia retrieval, and machine learning. Recently, many similarity caching policies have been proposed, like SIM-LRU and RND-LRU, but the performance analysis of their hit rate is still wanting. In this paper, we show how to extend the popular time-to-live approximation in classic caching to similarity caching. In particular, we propose a method to estimate the hit rate of the similarity caching policy RND-LRU. Our method, the RND-TTL approximation, introduces the RND-TTL cache model and then tunes its parameters in such a way to mimic the behavior of RND-LRU. The parameter tuning involves solving a fixed point system of equations for which we provide an algorithm for numerical resolution and sufficient conditions for its convergence. Our approach for approximating the hit rate of RND-LRU is evaluated on both synthetic and real world traces.

READ FULL TEXT
research
09/07/2022

Computing the Hit Rate of Similarity Caching

Similarity caching allows requests for an item i to be served by a simil...
research
12/09/2019

Similarity Caching: Theory and Algorithms

This paper focuses on similarity caching systems, in which a user reques...
research
09/07/2023

Keep-Alive Caching for the Hawkes process

We study the design of caching policies in applications such as serverle...
research
12/28/2017

Caching under Content Freshness Constraints

Several real-time delay-sensitive applications pose varying degrees of f...
research
07/02/2021

Ascent Similarity Caching with Approximate Indexes

Similarity search is a key operation in multimedia retrieval systems and...
research
08/04/2017

On Resource Pooling and Separation for LRU Caching

Caching systems using the Least Recently Used (LRU) principle have now b...
research
12/13/2021

Accelerating Deep Learning Classification with Error-controlled Approximate-key Caching

While Deep Learning (DL) technologies are a promising tool to solve netw...

Please sign up or login with your details

Forgot password? Click here to reset