Seeing Seeds Beyond Weeds: Green Teaming Generative AI for Beneficial Uses

05/30/2023
by   Logan Stapleton, et al.
12

Large generative AI models (GMs) like GPT and DALL-E are trained to generate content for general, wide-ranging purposes. GM content filters are generalized to filter out content which has a risk of harm in many cases, e.g., hate speech. However, prohibited content is not always harmful – there are instances where generating prohibited content can be beneficial. So, when GMs filter out content, they preclude beneficial use cases along with harmful ones. Which use cases are precluded reflects the values embedded in GM content filtering. Recent work on red teaming proposes methods to bypass GM content filters to generate harmful content. We coin the term green teaming to describe methods of bypassing GM content filters to design for beneficial use cases. We showcase green teaming by: 1) Using ChatGPT as a virtual patient to simulate a person experiencing suicidal ideation, for suicide support training; 2) Using Codex to intentionally generate buggy solutions to train students on debugging; and 3) Examining an Instagram page using Midjourney to generate images of anti-LGBTQ+ politicians in drag. Finally, we discuss how our use cases demonstrate green teaming as both a practical design method and a mode of critique, which problematizes and subverts current understandings of harms and values in generative AI.

READ FULL TEXT
research
03/02/2020

Business (mis)Use Cases of Generative AI

Generative AI is a class of machine learning technology that learns to g...
research
01/07/2021

Discussing the Risks of Adaptive Virtual Environments for User Autonomy

Adaptive virtual environments are an opportunity to support users and in...
research
03/21/2023

A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?

As ChatGPT goes viral, generative AI (AIGC, a.k.a AI-generated content) ...
research
02/20/2023

Affect-Conditioned Image Generation

In creativity support and computational co-creativity contexts, the task...
research
08/19/2021

Teaching Uncertainty Quantification in Machine Learning through Use Cases

Uncertainty in machine learning is not generally taught as general knowl...
research
08/09/2023

Where's the Liability in Harmful AI Speech?

Generative AI, in particular text-based "foundation models" (large model...
research
07/19/2023

Mitigating Viewer Impact from Disturbing Imagery using AI Filters: A User-Study

Exposure to disturbing imagery can significantly impact individuals, esp...

Please sign up or login with your details

Forgot password? Click here to reset