A Methodology for Creating AI FactSheets

06/24/2020
by   John Richards, et al.
0

As AI models and services are used in a growing number of highstakes areas, a consensus is forming around the need for a clearer record of how these models and services are developed to increase trust. Several proposals for higher quality and more consistent AI documentation have emerged to address ethical and legal concerns and general social impacts of such systems. However, there is little published work on how to create this documentation. This is the first work to describe a methodology for creating the form of AI documentation we call FactSheets. We have used this methodology to create useful FactSheets for nearly two dozen models. This paper describes this methodology and shares the insights we have gathered. Within each step of the methodology, we describe the issues to consider and the questions to explore with the relevant people in an organization who will be creating and consuming the AI facts in a FactSheet. This methodology will accelerate the broader adoption of transparent AI documentation.

READ FULL TEXT

page 10

page 12

page 13

page 15

page 16

research
11/11/2019

Experiences with Improving the Transparency of AI Models and Services

AI models and services are used in a growing number of highstakes areas,...
research
03/22/2021

A Novel Methodology For Crowdsourcing AI Models in an Enterprise

The evolution of AI is advancing rapidly, creating both challenges and o...
research
01/24/2022

Evaluating a Methodology for Increasing AI Transparency: A Case Study

In reaction to growing concerns about the potential harms of artificial ...
research
12/07/2020

An Approach to Intelligent Pneumonia Detection and Integration

Each year, over 2.5 million people, most of them in developed countries,...
research
04/30/2021

Ethical Implementation of Artificial Intelligence to Select Embryos in In Vitro Fertilization

AI has the potential to revolutionize many areas of healthcare. Radiolog...
research
10/07/2021

Automated Testing of AI Models

The last decade has seen tremendous progress in AI technology and applic...
research
03/17/2023

Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services

Recent years have seen growing adoption of AI-based decision-support sys...

Please sign up or login with your details

Forgot password? Click here to reset