Ecosystem Graphs: The Social Footprint of Foundation Models

03/28/2023
by   Rishi Bommasani, et al.
0

Foundation models (e.g. ChatGPT, StableDiffusion) pervasively influence society, warranting immediate social attention. While the models themselves garner much attention, to accurately characterize their impact, we must consider the broader sociotechnical ecosystem. We propose Ecosystem Graphs as a documentation framework to transparently centralize knowledge of this ecosystem. Ecosystem Graphs is composed of assets (datasets, models, applications) linked together by dependencies that indicate technical (e.g. how Bing relies on GPT-4) and social (e.g. how Microsoft relies on OpenAI) relationships. To supplement the graph structure, each asset is further enriched with fine-grained metadata (e.g. the license or training emissions). We document the ecosystem extensively at https://crfm.stanford.edu/ecosystem-graphs/. As of March 16, 2023, we annotate 262 assets (64 datasets, 128 models, 70 applications) from 63 organizations linked by 356 dependencies. We show Ecosystem Graphs functions as a powerful abstraction and interface for achieving the minimum transparency required to address myriad use cases. Therefore, we envision Ecosystem Graphs will be a community-maintained resource that provides value to stakeholders spanning AI researchers, industry professionals, social scientists, auditors and policymakers.

READ FULL TEXT

page 2

page 4

page 5

page 6

research
10/13/2021

Analysis of Indian Agricultural Ecosystem using Knowledge-based Tantra Framework

The information systems have been extremely useful in managing businesse...
research
03/28/2021

Scalable Call Graph Constructor for Maven

As a rich source of data, Call Graphs are used for various applications ...
research
09/03/2021

LightAutoML: AutoML Solution for a Large Financial Services Ecosystem

We present an AutoML system called LightAutoML developed for a large Eur...
research
08/08/2020

Service Ecosystem: A Lens of Smart Society

Intelligence services are playing an increasingly important role in the ...
research
02/28/2022

The Golden Circle: Creating Socio-technical Alignment in Content Moderation

This paper outlines a conceptual framework titled The Golden Circle that...
research
09/08/2023

Lessons from the Long Tail: Analysing Unsafe Dependency Updates across Software Ecosystems

A risk in adopting third-party dependencies into an application is their...
research
07/12/2023

Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomes

Machine learning is traditionally studied at the model level: researcher...

Please sign up or login with your details

Forgot password? Click here to reset