Caching Techniques to Improve Latency in Serverless Architectures

11/17/2019
by   Bishakh Chandra Ghosh, et al.
0

Serverless computing has gained a significant traction in recent times because of its simplicity of development, deployment and fine-grained billing. However, while implementing complex services comprising databases, file stores, or more than one serverless function, the performance in terms of latency of serving requests often degrades severely. In this work, we analyze different serverless architectures with AWS Lambda services and compare their performance in terms of latency with a traditional virtual machine (VM) based approach. We observe that database access latency in serverless architecture is almost 14 times than that in VM based setup. Further, we introduce some caching strategies which can improve the response time significantly, and compare their performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/18/2022

Improving the Performance of DNN-based Software Services using Automated Layer Caching

Deep Neural Networks (DNNs) have become an essential component in many a...
11/28/2017

A Framework for Semantic In-network Caching and Prefetching in 5G Mobile Networks

Recent popularity of mobile devices increased the demand for mobile netw...
10/30/2019

Human-Like Hybrid Caching in Software-defined Edge Cloud

With the development of Internet of Things (IoT) and communication techn...
07/06/2021

A Latency-Aware Real-Time Video Surveillance Demo: Network Slicing for Improving Public Safety

We report the automated deployment of 5G services across a latency-aware...
10/21/2009

Virtual-Threading: Advanced General Purpose Processors Architecture

The paper describes the new computers architecture, the main features of...
01/25/2022

Serving Deep Learning Models with Deduplication from Relational Databases

There are significant benefits to serve deep learning models from relati...
08/19/2020

FIRM: An Intelligent Fine-Grained Resource Management Framework for SLO-Oriented Microservices

Modern user-facing latency-sensitive web services include numerous distr...