Empirical Comparison of Black-box Test Case Generation Tools for RESTful APIs

08/18/2021
by   Davide Corradini, et al.
0

In literature, we can find research tools to automatically generate test cases for RESTful APIs, addressing the specificity of this particular programming domain. However, no direct comparison of these tools is available to guide developers in deciding which tool best fits their REST API project. In this paper, we present the results of an empirical comparison of automated black-box test case generation approaches for REST APIs. We surveyed the available black-box testing tools that have been proposed in recent literature, finding four usable prototypes: RestTestGen, RESTler, bBOXRT and RESTest. We used these tools to generate test cases for 14 real-world REST services. Then, testing results have been analyzed and compared in terms of robustness (i.e., success rate) and test coverage. Among the considered tools, RESTler appears to be the most solid, able to successfully test all case studies (the other tools experienced crashes). Conversely, test cases generated by RestTestGen scored the highest coverage, suggesting that its testing strategy is the most effective in testing REST APIs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/31/2021

REST API Fuzzing by Coverage Level Guided Blackbox Testing

With the growth of web applications, REST APIs have become the primary c...
research
04/18/2022

Automated Test Generation for REST APIs: No Time to Rest Yet

Modern web services routinely provide REST APIs for clients to access th...
research
08/18/2021

Restats: A Test Coverage Tool for RESTful APIs

Test coverage is a standard measure used to evaluate the completeness of...
research
09/14/2021

Improving Test Case Generation for REST APIs Through Hierarchical Clustering

With the ever-increasing use of web APIs in modern-day applications, it ...
research
08/24/2023

Automated Test Generation for Medical Rules Web Services: A Case Study at the Cancer Registry of Norway

The Cancer Registry of Norway (CRN) collects, curates, and manages data ...
research
05/16/2019

TERMINATOR: Better Automated UI Test Case Prioritization

Automated UI testing is an important component of the continuous integra...
research
06/27/2021

Effective grey-box testing with partial FSM models

For partial, nondeterministic, finite state machines, a new conformance ...

Please sign up or login with your details

Forgot password? Click here to reset