Revelio: ML-Generated Debugging Queries for Distributed Systems

06/28/2021
by   Pradeep Dogga, et al.
0

A major difficulty in debugging distributed systems lies in manually determining which of the many available debugging tools to use and how to query its logs. Our own study of a production debugging workflow confirms the magnitude of this burden. This paper explores whether a machine-learning model can assist developers in distributed systems debugging. We present Revelio, a debugging assistant which takes user reports and system logs as input, and outputs debugging queries that developers can use to find a bug's root cause. The key challenges lie in (1) combining inputs of different types (e.g., natural language reports and quantitative logs) and (2) generalizing to unseen faults. Revelio addresses these by employing deep neural networks to uniformly embed diverse input sources and potential queries into a high-dimensional vector space. In addition, it exploits observations from production systems to factorize query generation into two computationally and statistically simpler learning tasks. To evaluate Revelio, we built a testbed with multiple distributed applications and debugging tools. By injecting faults and training on logs and reports from 800 Mechanical Turkers, we show that Revelio includes the most helpful query in its predicted list of top-3 relevant queries 96 the time. Our developer study confirms the utility of Revelio.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

page 18

page 19

08/18/2021

What Distributed Systems Say: A Study of Seven Spark Application Logs

Execution logs are a crucial medium as they record runtime information o...
03/03/2021

Root cause prediction based on bug reports

This paper proposes a supervised machine learning approach for predictin...
02/01/2021

Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow

As a popular Q A site for programming, Stack Overflow is a treasure fo...
05/30/2020

An Empirical Study of Software Exceptions in the Field using Search Logs

Software engineers spend a substantial amount of time using Web search t...
04/04/2020

Towards Query Logs for Privacy Studies: On Deriving Search Queries from Questions

Translating verbose information needs into crisp search queries is a phe...
05/29/2021

Log2NS: Enhancing Deep Learning Based Analysis of Logs With Formal to Prevent Survivorship Bias

Analysis of large observational data sets generated by a reactive system...
04/15/2019

Modeling Hierarchical Usage Context for Software Exceptions based on Interaction Data

Traces of user interactions with a software system, captured in producti...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.