Challenges and guidelines on designing test cases for test bots

04/21/2020
by   Linda Erlenhov, et al.
0

Test bots are automated testing tools that autonomously and periodically run a set of test cases that check whether the system under test meets the requirements set forth by the customer. The automation decreases the amount of time a development team spends on testing. As development projects become larger, it is important to focus on improving the test bots by designing more effective test cases because otherwise time and usage costs can increase greatly and misleading conclusions from test results might be drawn, such as false positives in the test execution. However, literature currently lacks insights on how test case design affects the effectiveness of test bots. This paper uses a case study approach to investigate those effects by identifying challenges in designing tests for test bots. Our results include guidelines for test design schema for such bots that support practitioners in overcoming the challenges mentioned by participants during our study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/22/2023

A multi-case study of agile requirements engineering and the use of test cases as requirements

Context: It is an enigma that agile projects can succeed 'without requir...
research
02/02/2022

Automatic Creation of Acceptance Tests by Extracting Conditionals from Requirements: NLP Approach and Case Study

Acceptance testing is crucial to determine whether a system fulfills end...
research
02/22/2018

Tapir: Automation Support of Exploratory Testing Using Model Reconstruction of the System Under Test

For a considerable number of software projects, the creation of effectiv...
research
08/12/2023

An Industrial Case Study on Test Cases as Requirements

It is a conundrum that agile projects can succeed 'without requirements'...
research
12/09/2022

Industrially Applicable System Regression Test Prioritization in Production Automation

When changes are performed on an automated production system (aPS), new ...
research
07/15/2018

Visualizing test diversity to support test optimisation

Diversity has been used as an effective criteria to optimise test suites...
research
03/08/2021

Towards Human-Like Automated Test Generation: Perspectives from Cognition and Problem Solving

Automated testing tools typically create test cases that are different f...

Please sign up or login with your details

Forgot password? Click here to reset