The Metamorphosis: Automatic Detection of Scaling Issues for Mobile Apps

12/08/2022
by   Yuhui Su, et al.
0

As the bridge between users and software, Graphical User Interface (GUI) is critical to the app accessibility. Scaling up the font or display size of GUI can help improve the visual impact, readability, and usability of an app, and is frequently used by the elderly and people with vision impairment. Yet this can easily lead to scaling issues such as text truncation, component overlap, which negatively influence the acquirement of the right information and the fluent usage of the app. Previous techniques for UI display issue detection and cross-platform inconsistency detection cannot work well for these scaling issues. In this paper, we propose an automated method, dVermin, for scaling issue detection, through detecting the inconsistency of a view under the default and a larger display scale. The evaluation result shows that dVermin achieves 97 precision and 91 state-of-the-art baselines by a large margin. We also evaluate dVermin with popular Android apps on F-droid, and successfully uncover 21 previously-undetected scaling issues with 20 of them being confirmed/fixed.

READ FULL TEXT

page 4

page 8

page 10

research
05/27/2022

Nighthawk: Fully Automated Localizing UI Display Issues via Visual Understanding

Graphical User Interface (GUI) provides a visual bridge between a softwa...
research
09/03/2020

Owl Eyes: Spotting UI Display Issues via Visual Understanding

Graphical User Interface (GUI) provides a visual bridge between a softwa...
research
07/06/2021

OwlEyes-Online: A Fully Automated Platform for Detecting and Localizing UI Display Issues

Graphical User Interface (GUI) provides visual bridges between software ...
research
08/08/2020

Automated Functional Fuzzing of Android Apps

Android apps are GUI-based event-driven software and have become ubiquit...
research
09/19/2022

Detecting and Fixing Data Loss Issues in Android Apps

Android apps are event-driven, and their execution is often interrupted ...
research
08/17/2023

Automated and Context-Aware Repair of Color-Related Accessibility Issues for Android Apps

Approximately 15 disabilities or impairments. However, many mobile UX de...
research
09/24/2016

DimensionApp : android app to estimate object dimensions

In this project, we develop an android app that uses on computer vision ...

Please sign up or login with your details

Forgot password? Click here to reset