DeepAI
Log In Sign Up

An Autonomous Performance Testing Framework using Self-Adaptive Fuzzy Reinforcement Learning

08/19/2019
by   Mahshid Helali Moghadam, et al.
0

Test automation can result in reduction in cost and human effort. If the optimal policy, the course of actions taken, for the intended objective in a testing process could be learnt by the testing system (e.g., a smart tester agent), then it could be reused in similar situations, thus leading to higher efficiency, i.e., less computational time. Automating stress testing to find performance breaking points remains a challenge for complex software systems. Common approaches are mainly based on source code or system model analysis or use-case based techniques. However, source code or system models might not be available at testing time. In this paper, we propose a self-adaptive fuzzy reinforcement learning-based performance (stress) testing framework (SaFReL) that enables the tester agent to learn the optimal policy for generating stress test cases leading to performance breaking point without access to performance model of the system under test. SaFReL learns the optimal policy through an initial learning, then reuses it during a transfer learning phase, while keeping the learning running in the long-term. Through multiple experiments on a simulated environment, we demonstrate that our approach generates the stress test cases for different programs efficiently and adaptively without access to performance models.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/26/2021

Performance Testing Using a Smart Reinforcement Learning-Driven Test Agent

Performance testing with the aim of generating an efficient and effectiv...
11/09/2018

Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration

Testing in Continuous Integration (CI) involves test case prioritization...
09/10/2020

MicroGrad: A Centralized Framework for Workload Cloning and Stress Testing

We present MicroGrad, a centralized automated framework that is able to ...
02/12/2018

Test Agents: Adaptive, Autonomous and Intelligent Test Cases

Growth of software size, lack of resources to perform regression testing...
10/01/2019

Adaptive Metamorphic Testing with Contextual Bandits

Metamorphic Testing is a software testing paradigm which aims at using n...
01/29/2022

DeepRNG: Towards Deep Reinforcement Learning-Assisted Generative Testing of Software

Although machine learning (ML) has been successful in automating various...
11/13/2018

Learning to Compensate Photovoltaic Power Fluctuations from Images of the Sky by Imitating an Optimal Policy

The energy output of photovoltaic (PV) power plants depends on the envir...