Log In Sign Up

An Autonomous Performance Testing Framework using Self-Adaptive Fuzzy Reinforcement Learning

by   Mahshid Helali Moghadam, et al.

Test automation can result in reduction in cost and human effort. If the optimal policy, the course of actions taken, for the intended objective in a testing process could be learnt by the testing system (e.g., a smart tester agent), then it could be reused in similar situations, thus leading to higher efficiency, i.e., less computational time. Automating stress testing to find performance breaking points remains a challenge for complex software systems. Common approaches are mainly based on source code or system model analysis or use-case based techniques. However, source code or system models might not be available at testing time. In this paper, we propose a self-adaptive fuzzy reinforcement learning-based performance (stress) testing framework (SaFReL) that enables the tester agent to learn the optimal policy for generating stress test cases leading to performance breaking point without access to performance model of the system under test. SaFReL learns the optimal policy through an initial learning, then reuses it during a transfer learning phase, while keeping the learning running in the long-term. Through multiple experiments on a simulated environment, we demonstrate that our approach generates the stress test cases for different programs efficiently and adaptively without access to performance models.


page 1

page 2

page 3

page 4


Performance Testing Using a Smart Reinforcement Learning-Driven Test Agent

Performance testing with the aim of generating an efficient and effectiv...

Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration

Testing in Continuous Integration (CI) involves test case prioritization...

MicroGrad: A Centralized Framework for Workload Cloning and Stress Testing

We present MicroGrad, a centralized automated framework that is able to ...

Test Agents: Adaptive, Autonomous and Intelligent Test Cases

Growth of software size, lack of resources to perform regression testing...

Adaptive Metamorphic Testing with Contextual Bandits

Metamorphic Testing is a software testing paradigm which aims at using n...

DeepRNG: Towards Deep Reinforcement Learning-Assisted Generative Testing of Software

Although machine learning (ML) has been successful in automating various...

Learning to Compensate Photovoltaic Power Fluctuations from Images of the Sky by Imitating an Optimal Policy

The energy output of photovoltaic (PV) power plants depends on the envir...