Designing AI for Online-to-Offline Safety Risks with Young Women: The Context of Social Matching

04/01/2022
by   Douglas Zytko, et al.
0

In this position paper we draw attention to safety risks against youth and young adults that originate through the combination of online and in-person interaction, and opportunities for AI to address these risks. Our context of study is social matching systems (e.g., Tinder, Bumble), which are used by young adults for online-to-offline interaction with strangers, and which are correlated with sexual violence both online and in-person. The paper presents early insights from an ongoing participatory AI design study in which young women build directly explainable models for detecting risk associated with discovered social opportunities, and articulate what AI should do once risk has been detected. We seek to advocate for participatory AI design as a way to directly incorporate youth and young adults into the design of a safer Internet. We also draw attention to challenges with the method.

READ FULL TEXT

page 1

page 3

research
04/01/2022

Human-AI Interaction for User Safety in Social Matching Apps: Involving Marginalized Users in Design

In this position paper we intend to advocate for participatory design me...
research
03/20/2022

Synergy between 6G and AI: Open Future Horizons and Impending Security Risks

This paper investigates the synergy between 6G and AI. It argues that th...
research
04/22/2021

Understanding and Avoiding AI Failures: A Practical Guide

As AI technologies increase in capability and ubiquity, AI accidents are...
research
09/13/2022

Quantitative AI Risk Assessments: Opportunities and Challenges

Although AI-based systems are increasingly being leveraged to provide va...
research
05/26/2023

Attention Paper: How Generative AI Reshapes Digital Shadow Industry?

The rapid development of digital economy has led to the emergence of var...
research
03/20/2023

Heterogeneity of AI-Induced Societal Harms and the Failure of Omnibus AI Laws

AI-induced societal harms mirror existing problems in domains where AI r...

Please sign up or login with your details

Forgot password? Click here to reset