K-Detector: Identifying Duplicate Crash Failures in Large-Scale Software Delivery

05/31/2022
by   Hao Yang, et al.
0

After a developer submits code, corresponding test cases arise to ensure the quality of software delivery. Test failures would occur during this period, such as crash, error, and timeout. Since it takes time for developers to resolve them, many duplicate failures will happen during this period. In the delivery practice of SAP HANA, crash triage is considered as the most time-consuming task. If duplicate crash failures can be automatically identified, the degree of automation will be significantly enhanced. To find such duplicates, we propose a training-based mathematical model that utilizes component information of SAP HANA to achieve better crash similarity comparison. We implement our approach in a tool named Knowledge-based Detector (K-Detector), which is verified by 11,208 samples and performs 0.986 in AUC. Furthermore, we have deployed K-Detector to the production environment, and it can save 97

READ FULL TEXT
research
06/03/2019

Empirical Analysis of Factors and their Effect on Test Flakiness - Practitioners' Perceptions

Developers always wish to ensure that their latest changes to the code b...
research
03/07/2023

Do the Test Smells Assertion Roulette and Eager Test Impact Students' Troubleshooting and Debugging Capabilities?

To ensure the quality of a software system, developers perform an activi...
research
11/16/2021

Automated System-Level Software Testing of Industrial Networked Embedded Systems

Embedded systems are ubiquitous and play critical roles in management sy...
research
02/28/2022

Automatic Test-Case Reduction in Proof Assistants: A Case Study in Coq

As the adoption of proof assistants increases, there is a need for effic...
research
04/17/2020

Exploratory Test Agents for Stateful Software Systems

The adequate testing of stateful software systems is a hard and costly a...
research
08/10/2023

Testing GPT-4 with Wolfram Alpha and Code Interpreter plug-ins on math and science problems

This report describes a test of the large language model GPT-4 with the ...

Please sign up or login with your details

Forgot password? Click here to reset