DeepAI AI Chat
Log In Sign Up

Avgust: Automating Usage-Based Test Generation from Videos of App Executions

09/06/2022
by   Yixue Zhao, et al.
University of Massachusetts Amherst
University of Southern California
George Mason University
0

Writing and maintaining UI tests for mobile apps is a time-consuming and tedious task. While decades of research have produced automated approaches for UI test generation, these approaches typically focus on testing for crashes or maximizing code coverage. By contrast, recent research has shown that developers prefer usage-based tests, which center around specific uses of app features, to help support activities such as regression testing. Very few existing techniques support the generation of such tests, as doing so requires automating the difficult task of understanding the semantics of UI screens and user inputs. In this paper, we introduce Avgust, which automates key steps of generating usage-based tests. Avgust uses neural models for image understanding to process video recordings of app uses to synthesize an app-agnostic state-machine encoding of those uses. Then, Avgust uses this encoding to synthesize test cases for a new target app. We evaluate Avgust on 374 videos of common uses of 18 popular apps and show that 69 successfully execute the desired usage, and that Avgust's classifiers outperform the state of the art.

READ FULL TEXT

page 4

page 6

10/24/2017

DroidWalker: Generating Reproducible Test Cases via Automatic Exploration of Android Apps

Generating test cases through automatic app exploration is very useful f...
04/12/2021

An Evolutionary Approach to Adapt Tests Across Mobile Apps

Automatic generators of GUI tests often fail to generate semantically re...
07/12/2021

Automated Mobile App Test Script Intent Generation via Image and Code Understanding

Testing is the most direct and effective technique to ensure software qu...
08/08/2020

FrUITeR: A Framework for Evaluating UI Test Reuse

UI testing is tedious and time-consuming due to the manual effort requir...
07/09/2022

Extracting Replayable Interactions from Videos of Mobile App Usage

Screen recordings of mobile apps are a popular and readily available way...
12/04/2020

Automated, Cost-effective, and Update-driven App Testing

Apps' pervasive role in our society led to the definition of test automa...
02/02/2020

An Automated Testing Framework For Smart TV apps Based on Model Separation

Smart TV application (app) is a new technological software app that can ...