A study on Modern Messaging Systems- Kafka, RabbitMQ and NATS Streaming

by   Sharvari T, et al.

Distributed messaging systems form the core of big data streaming, cloud native applications and microservice architecture. With real-time critical applications there is a growing need for well-built messaging platform that is scalable, fault tolerant and has low latency. There are multiple modern messaging systems that have come up in the recent past, all with their own pros and cons. This has become problematic for the industry to decide which messaging system is the most suitable for a specific application. An in-depth study is required to decide which features of a messaging system meet the needs of the application. This survey paper outlines the modern messaging technologies and delves deep on three popular publisher/subscriber systems- Apache Kafka, RabbitMQ and NATS Streaming. The paper provides information about messaging systems, the use cases, similarities and differences of features to facilitate users to make an informed decision and also pave way for future research and development.



There are no comments yet.


page 1


Scalable real-time processing with Spark Streaming: implementation and design of a Car Information System

Streaming data processing is a hot topic in big data these days, because...

AlertMix: A Big Data platform for multi-source streaming data

The demand for stream processing is increasing at an unprecedented rate....

Railgun: streaming windows for mission critical systems

Some mission critical systems, such as fraud detection, require accurate...

Railgun: managing large streaming windows under MAD requirements

Some mission critical systems, e.g., fraud detection, require accurate, ...

A Cloud Native Platform for Stateful Streaming

We present the architecture of a cloud native version of IBM Streams, wi...

BigSR: an empirical study of real-time expressive RDF stream reasoning on modern Big Data platforms

The trade-off between language expressiveness and system scalability (E&...

Distributed Learning in the Non-Convex World: From Batch to Streaming Data, and Beyond

Distributed learning has become a critical enabler of the massively conn...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.