Accelerating netty-based applications through transparent InfiniBand support

09/28/2022
by   Fabian Ruhland, et al.
0

Many big-data frameworks are written in Java, e.g. Apache Spark, Flink and Cassandra. These systems use the networking framework netty which is based on Java NIO. While this allows for fast networking on traditional Ethernet networks, it cannot fully exploit the whole performance of modern interconnects, like InfiniBand, providing bandwidths of 100 Gbit/s and more. In this paper we propose netty support for hadroNIO, a Java library, providing transparent InfiniBand support for Java applications based on NIO. hadroNIO is based on UCX, which supports several interconnects, including InfiniBand. We present hadroNIO extensions and optimizations for supporting netty. The evaluations with microbenchmarks, covering single- and multi-threaded scenarios, show that it is possible for netty applications to reach round-trip times as low as 5 us and fully utilize the 100 Gbit/s bandwidth of high-speed NICs, without changing the application's source code. We also compare hadroNIO with traditional sockets, as well as libvma and the results show, that hadroNIO offers a substantial improvement over plain sockets and can outperform libvma in several scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/10/2018

A Simple Java Code Generator for ACL2 Based on a Deep Embedding of ACL2 in Java

AIJ (ACL2 In Java) is a deep embedding in Java of an executable, side-ef...
research
10/05/2019

A Benchmark to Evaluate InfiniBand Solutions for Java Applications

Low-latency network interconnects, such as InfiniBand, are commonly used...
research
09/08/2017

Java Extensions for OMNeT++

On the one side, network simulation frameworks are important tools for r...
research
05/15/2023

Dragon-Alpha cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Java is very powerful, but in Deep Learning field, its capabilities prob...
research
12/05/2018

Ibdxnet: Leveraging InfiniBand in Highly Concurrent Java Applications

In this report, we describe the design and implementation of Ibdxnet, a ...
research
09/23/2015

IllinoisSL: A JAVA Library for Structured Prediction

IllinoisSL is a Java library for learning structured prediction models. ...
research
04/25/2023

Automatic Extraction of Security-Rich Dataflow Diagrams for Microservice Applications written in Java

Dataflow diagrams (DFDs) are a valuable asset for securing applications,...

Please sign up or login with your details

Forgot password? Click here to reset