Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database

11/17/2020
by   Sean McGregor, et al.
0

Mature industrial sectors (e.g., aviation) collect their real world failures in incident databases to inform safety improvements. Intelligent systems currently cause real world harms without a collective memory of their failings. As a result, companies repeatedly make the same mistakes in the design, development, and deployment of intelligent systems. A collection of intelligent system failures experienced in the real world (i.e., incidents) is needed to ensure intelligent systems benefit people and society. The AI Incident Database is an incident collection initiated by an industrial/non-profit cooperative to enable AI incident avoidance and mitigation. The database supports a variety of research and development use cases with faceted and full text search on more than 1,000 incident reports archived to date.

READ FULL TEXT

page 1

page 4

page 6

research
06/15/2022

AI Ethics Issues in Real World: Evidence from AI Incident Database

With the powerful performance of Artificial Intelligence (AI) also comes...
research
10/25/2016

Artificial Intelligence Safety and Cybersecurity: a Timeline of AI Failures

In this work, we present and analyze reported failures of artificially i...
research
09/23/2021

Discovering and Validating AI Errors With Crowdsourced Failure Reports

AI systems can fail to learn important behaviors, leading to real-world ...
research
08/24/2017

Results of the Survey: Failures in Robotics and Intelligent Systems

In January 2015 we distributed an online survey about failures in roboti...
research
11/18/2022

Indexing AI Risks with Incidents, Issues, and Variants

Two years after publicly launching the AI Incident Database (AIID) as a ...
research
06/19/2019

Metrics and Benchmarks for Remote Shared Controllers in Industrial Applications

Remote manipulation is emerging as one of the key robotics tasks needed ...
research
10/04/2022

Enabling Serverless Deployment of Large-Scale AI Workloads

We propose a set of optimization techniques for transforming a generic A...

Please sign up or login with your details

Forgot password? Click here to reset