Sapphire: Automatic Configuration Recommendation for Distributed Storage Systems

07/07/2020
by   Wenhao Lyu, et al.
0

Modern distributed storage systems come with aplethora of configurable parameters that controlmodule behavior and affect system performance. Default settings provided by developers are often suboptimal for specific user cases. Tuning parameters can provide significant performance gains but is a difficult task requiring profound experience and expertise, due to the immense number of configurable parameters, complex inner dependencies and non-linearsystem behaviors. To overcome these difficulties, we propose an automatic simulation-based approach, Sapphire, to recommend optimal configurations by leveraging machine learning and black-box optimization techniques. We evaluate Sapphire on Ceph. Results show that Sapphire significantly boosts Ceph performance to 2.2x compared to the default configuration.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2017

Hot-Rodding the Browser Engine: Automatic Configuration of JavaScript Compilers

Modern software systems in many application areas offer to the user a mu...
research
12/23/2022

NoSQL Database Tuning through Machine Learning

NoSQL databases have become an important component of many big data and ...
research
07/19/2022

Magpie: Automatically Tuning Static Parameters for Distributed File Systems using Deep Reinforcement Learning

Distributed file systems are widely used nowadays, yet using their defau...
research
10/10/2017

BestConfig: Tapping the Performance Potential of Systems via Automatic Configuration Tuning

An ever increasing number of configuration parameters are provided to sy...
research
02/17/2023

DMSConfig: Automated Configuration Tuning for Distributed IoT Message Systems Using Deep Reinforcement Learning

The Distributed Messaging Systems (DMSs) used in IoT systems require tim...
research
01/16/2023

IOPathTune: Adaptive Online Parameter Tuning for Parallel File System I/O Path

Parallel file systems contain complicated I/O paths from clients to stor...
research
12/26/2016

Clustering Algorithms: A Comparative Approach

Many real-world systems can be studied in terms of pattern recognition t...

Please sign up or login with your details

Forgot password? Click here to reset