What do all these Buttons do? Statically Mining Android User Interfaces at Scale

05/07/2021
by   Konstantin Kuznetsov, et al.
0

We introduce FRONTMATTER: a tool to automatically mine both user interface models and behavior of Android apps at a large scale with high precision. Given an app, FRONTMATTER statically extracts all declared screens, the user interface elements, their textual and graphical features, as well as Android APIs invoked by interacting with them. Executed on tens of thousands of real-world apps, FRONTMATTER opens the door for comprehensive mining of mobile user interfaces, jumpstarting empirical research at a large scale, addressing questions such as "How many travel apps require registration?", "Which apps do not follow accessibility guidelines?", "Does the user interface correspond to the description?", and many more. FRONTMATTER and the mined dataset are available under an open-source license.

READ FULL TEXT
research
12/21/2018

Do we agree on user interface aesthetics of Android apps?

Context: Visual aesthetics is increasingly seen as an essential factor i...
research
02/28/2019

Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning

Tapping is an immensely important gesture in mobile touchscreen interfac...
research
03/08/2021

Siri, Write the Next Method

Code completion is one of the killer features of Integrated Development ...
research
01/22/2018

Large-Scale Analysis of Framework-Specific Exceptions in Android Apps

Mobile apps have become ubiquitous. For app developers, it is a key prio...
research
06/17/2022

Detecting Connectivity Issues in Android Apps

Android is the most popular mobile operating system in the world, runnin...
research
08/17/2023

Never-ending Learning of User Interfaces

Machine learning models have been trained to predict semantic informatio...
research
09/19/2018

Divide and Conquer: Recovering Contextual Information of Behaviors in Android Apps around Limited-quantity Audit Logs

Android users are now suffering serious threats from various unwanted ap...

Please sign up or login with your details

Forgot password? Click here to reset