Rally and WebScience: A Platform and Toolkit for Browser-Based Research on Technology and Society Problems

11/04/2022
by   Anne Kohlbrenner, et al.
0

Empirical technology and society research is in a methodological crisis. Problems increasingly involve closed platforms, targeted content, and context-specific behavior. Prevailing research methods, such as surveys, tasks, and web crawls, pose design and ecological validity limitations. Deploying studies in participant browsers and devices is a promising direction. These vantage points can observe individualized experiences and implement UI interventions in real settings. We survey scholarship that uses these methods, annotating 284 sampled papers. Our analysis demonstrates their potential, but also recurring implementation barriers and shortcomings. We then present Rally and sdkName, a platform and toolkit for browser-based research. These systems lower implementation barriers and advance the science of measuring online behavior. Finally, we evaluate Rally and sdkName against our design goals. We report results from a one-month pilot study on news engagement, analyzing 4,466,200 webpage visits from 1,817 participants. We also present observations from interviews with researchers using these systems.

READ FULL TEXT
research
04/23/2021

Self-Tracking Technology for mHealth: A Systematic Review and the PAST SELF Framework

In today's connected society, many people rely on mHealth and self-track...
research
04/12/2023

Anticipating Unintended Consequences of Technology Using Insights from Creativity Support Tools

Our society has been increasingly witnessing a number of negative, unint...
research
04/07/2023

An Accessible Toolkit for 360 VR Studies

Virtual reality is expected to play a significant role in the transforma...
research
03/04/2021

An Agent-based Model to Evaluate Interventions on Online Dating Platforms to Decrease Racial Homogamy

Perhaps the most controversial questions in the study of online platform...
research
02/14/2020

Toward Agile Situated Visualization: An Exploratory User Study

We introduce AVAR, a prototypical implementation of an agile situated vi...
research
02/21/2023

Democratizing Making: Scaffolding Participation Using e-Waste to Engage Under-resourced Communities in Technology Design

Maker culture and DIY practices are central to democratizing the design ...

Please sign up or login with your details

Forgot password? Click here to reset