GLIB: Towards Automated Test Oracle for Graphically-Rich Applications

06/19/2021
by   Ke Chen, et al.
0

Graphically-rich applications such as games are ubiquitous with attractive visual effects of Graphical User Interface (GUI) that offers a bridge between software applications and end-users. However, various types of graphical glitches may arise from such GUI complexity and have become one of the main component of software compatibility issues. Our study on bug reports from game development teams in NetEase Inc. indicates that graphical glitches frequently occur during the GUI rendering and severely degrade the quality of graphically-rich applications such as video games. Existing automated testing techniques for such applications focus mainly on generating various GUI test sequences and check whether the test sequences can cause crashes. These techniques require constant human attention to captures non-crashing bugs such as bugs causing graphical glitches. In this paper, we present the first step in automating the test oracle for detecting non-crashing bugs in graphically-rich applications. Specifically, we propose based on a code-based data augmentation technique to detect game GUI glitches. We perform an evaluation of on 20 real-world game apps (with bug reports available) and the result shows that can achieve 100% precision and 99.5% recall in detecting non-crashing bugs such as game GUI glitches. Practical application of on another 14 real-world games (without bug reports) further demonstrates that can effectively uncover GUI glitches, with 48 of 53 bugs reported by having been confirmed and fixed so far.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

page 10

research
01/28/2023

Characterizing and Detecting WebAssembly Runtime Bugs

WebAssembly (abbreviated WASM) has emerged as a promising language of th...
research
07/20/2020

Visual Testing of GUIs by Abstraction

Ensuring the correct visual appearance of graphical user interfaces (GUI...
research
08/03/2022

Automatically Detecting Visual Bugs in HTML5 <canvas> Games

The HTML5 <canvas> is used to display high quality graphics in web appli...
research
03/29/2019

Train One Get One Free: Partially Supervised Neural Network for Bug Report Duplicate Detection and Clustering

Tracking user reported bugs requires considerable engineering effort in ...
research
05/07/2018

Effective Automated Decision Support for Managing Crowdtesting

Crowdtesting has grown to be an effective alter-native to traditional te...
research
09/03/2020

Owl Eyes: Spotting UI Display Issues via Visual Understanding

Graphical User Interface (GUI) provides a visual bridge between a softwa...
research
10/06/2021

How good does a Defect Predictor need to be to guide Search-Based Software Testing?

Defect predictors, static bug detectors and humans inspecting the code c...

Please sign up or login with your details

Forgot password? Click here to reset