A Method for Generating Dynamic Responsible AI Guidelines for Collaborative Action
share
To improve the development of responsible AI systems, developers are increasingly utilizing tools such as checklists or guideline cards to ensure fairness, transparency, and sustainability. However, these tools face two main challenges. First, they are static and are not meant to keep pace with the latest responsible AI literature and international standards. Second, they tend to prioritize individual usage over fostering collaboration among AI practitioners. To overcome these limitations, we propose a method that enables easy updates of responsible AI guidelines by incorporating research papers and ISO standards, ensuring that the content remains relevant and up to date, while emphasizing actionable guidelines that can be implemented by a wide range of AI practitioners. We validated our method in a case study at a large tech company by designing and deploying a tool that recommends interactive and actionable guidelines, which were generated by a team of engineers, standardization experts, and a lawyer using our method. Through the study involving AI developers and engineers, we assessed the usability and effectiveness of the tool, showing that the guidelines were considered practical and actionable. The guidelines encouraged self-reflection and facilitated a better understanding of the ethical considerations of AI during the early stages of development, significantly contributing to the idea of "Responsible AI by Design" – a design-first approach that considers responsible AI values throughout the development lifecycle and across business roles.
READ FULL TEXT