Caching Techniques to Improve Latency in Serverless Architectures

11/17/2019
by   Bishakh Chandra Ghosh, et al.
0

Serverless computing has gained a significant traction in recent times because of its simplicity of development, deployment and fine-grained billing. However, while implementing complex services comprising databases, file stores, or more than one serverless function, the performance in terms of latency of serving requests often degrades severely. In this work, we analyze different serverless architectures with AWS Lambda services and compare their performance in terms of latency with a traditional virtual machine (VM) based approach. We observe that database access latency in serverless architecture is almost 14 times than that in VM based setup. Further, we introduce some caching strategies which can improve the response time significantly, and compare their performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/18/2022

Improving the Performance of DNN-based Software Services using Automated Layer Caching

Deep Neural Networks (DNNs) have become an essential component in many a...
research
08/05/2023

An Overview of Analysis Methods and Evaluation Results for Caching Strategies

We survey analytical methods and evaluation results for the performance ...
research
05/18/2023

Hibernate Container: A Deflated Container Mode for Fast Startup and High-density Deployment in Serverless Computing

Serverless computing is a popular cloud computing paradigm, which requir...
research
09/21/2023

Latency-Aware Radio Resource Optimization in Learning-Based Cloud-Aided Small Cell Wireless Networks

Low latency communication is one of the fundamental requirements for 5G ...
research
10/21/2009

Virtual-Threading: Advanced General Purpose Processors Architecture

The paper describes the new computers architecture, the main features of...
research
04/18/2023

Sparks of GPTs in Edge Intelligence for Metaverse: Caching and Inference for Mobile AIGC Services

Aiming at achieving artificial general intelligence (AGI) for Metaverse,...
research
01/25/2022

Serving Deep Learning Models with Deduplication from Relational Databases

There are significant benefits to serve deep learning models from relati...

Please sign up or login with your details

Forgot password? Click here to reset