DeepAI AI Chat
Log In Sign Up

Quickstrom: Property Based Acceptance Testing with LTL Specifications

03/22/2022
by   Liam O'Connor, et al.
0

We present Quickstrom, a property-based testing system for acceptance testing of interactive applications. Using Quickstrom, programmers can specify the behaviour of web applications as properties in our testing-oriented dialect of Linear Temporal Logic (LTL) called QuickLTL, and then automatically test their application against the given specification with hundreds of automatically generated interactions. QuickLTL extends existing finite variants of LTL for the testing use-case, determining likely outcomes from partial traces whose minimum length is itself determined by the LTL formula. This temporal logic is embedded in our specification language, Specstrom, which is designed to be approachable to web programmers, expressive for writing specifications, and easy to analyse. Because Quickstrom tests only user-facing behaviour, it is agnostic to the implementation language of the system under test. We therefore formally specify and test many implementations of the popular TodoMVC benchmark, used for evaluation and comparison across various web frontend frameworks and languages. Our tests uncovered bugs in almost half of the available implementations.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/24/2023

Carving UI Tests to Generate API Tests and API Specification

Modern web applications make extensive use of API calls to update the UI...
01/08/2019

StaBL - State Based Language for Specification of Web Applications

Context and motivation: Usage of Formal Specification languages is scarc...
05/07/2021

Executable Interval Temporal Logic Specifications

In this paper the reversibility of executable Interval Temporal Logic (I...
01/31/2021

Model-Based Testing of Networked Applications

We present a rigorous framework for automatically testing application-la...
06/14/2022

Specification sketching for Linear Temporal Logic

Virtually all verification and synthesis techniques assume that the form...
10/03/2022

Testing by Dualization

Software engineering requires rigorous testing to guarantee the product'...
04/24/2018

Developing Theoretical Foundations for Runtime Enforcement

The ubiquitous reliance on software systems increases the need for ensur...