Towards Soft Circuit Breaking in Service Meshes via Application-agnostic Caching

04/06/2021
by   Lars Larsson, et al.
0

Service meshes factor out code dealing with inter-micro-service communication, such as circuit breaking. Circuit breaking actuation is currently limited to an "on/off" switch, i.e., a tripped circuit breaker will return an application-level error indicating service unavailability to the calling micro-service. This paper proposes a soft circuit breaker actuator, which returns cached data instead of an error. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. We evaluate our approach through two experiments. First, we quantify the trade-off between traffic reduction and data staleness using a purpose-build service, thereby identifying algorithm configurations that keep data staleness at about 3 network load by up to 30 the micro-service benchmark by Google Cloud called Hipster Shop. Our approach results in caching of about 80 efficiency of our approach, which encourages implementing caching as a circuit breaking actuator in service meshes.

READ FULL TEXT
research
07/02/2022

Dissecting Service Mesh Overheads

Service meshes play a central role in the modern application ecosystem b...
research
07/02/2021

A Micro-Service based Approach for Constructing Distributed Storage System

This paper presents an approach for constructing distributed storage sys...
research
03/21/2023

Research on Efficiency Analysis of Microservices

With the maturity of web services, containers, and cloud computing techn...
research
08/05/2023

An Overview of Analysis Methods and Evaluation Results for Caching Strategies

We survey analytical methods and evaluation results for the performance ...
research
02/10/2019

Exploring Micro-Services for Enhancing Internet QoS

With the enhancements in the field of software-defined networking and vi...
research
09/28/2017

Tolerating Soft Errors in Processor Cores Using CLEAR (Cross-Layer Exploration for Architecting Resilience)

We present CLEAR (Cross-Layer Exploration for Architecting Resilience), ...
research
08/07/2020

Security Design Patterns in Distributed Microservice Architecture

Micro service architecture has revolutionized the landscape for the deve...

Please sign up or login with your details

Forgot password? Click here to reset