Validation and Transparency in AI systems for pharmacovigilance: a case study applied to the medical literature monitoring of adverse events

12/21/2021
by   Bruno Ohana, et al.
0

Recent advances in artificial intelligence applied to biomedical text are opening exciting opportunities for improving pharmacovigilance activities currently burdened by the ever growing volumes of real world data. To fully realize these opportunities, existing regulatory guidance and industry best practices should be taken into consideration in order to increase the overall trustworthiness of the system and enable broader adoption. In this paper we present a case study on how to operationalize existing guidance for validated AI systems in pharmacovigilance focusing on the specific task of medical literature monitoring (MLM) of adverse events from the scientific literature. We describe an AI system designed with the goal of reducing effort in MLM activities built in close collaboration with subject matter experts and considering guidance for validated systems in pharmacovigilance and AI transparency. In particular we make use of public disclosures as a useful risk control measure to mitigate system misuse and earn user trust. In addition we present experimental results showing the system can significantly remove screening effort while maintaining high levels of recall (filtering 55 irrelevant articles on average, for a target recall of 0.99 on suspected adverse articles) and provide a robust method for tuning the desired recall to suit a particular risk profile.

READ FULL TEXT
research
06/17/2022

Actionable Guidance for High-Consequence AI Risk Management: Towards Standards Addressing AI Catastrophic Risks

Artificial intelligence (AI) systems can provide many beneficial capabil...
research
12/23/2020

Antitrust and Artificial Intelligence (AAI): Antitrust Vigilance Lifecycle and AI Legal Reasoning Autonomy

There is an increasing interest in the entwining of the field of antitru...
research
03/05/2021

A framework for fostering transparency in shared artificial intelligence models by increasing visibility of contributions

Increased adoption of artificial intelligence (AI) systems into scientif...
research
02/25/2020

Distributed Ledger for Provenance Tracking of Artificial Intelligence Assets

High availability of data is responsible for the current trends in Artif...
research
12/13/2019

Enabling Value Sensitive AI Systems through Participatory Design Fictions

Two general routes have been followed to develop artificial agents that ...
research
04/04/2022

How Can We Develop Explainable Systems? Insights from a Literature Review and an Interview Study

Quality aspects such as ethics, fairness, and transparency have been pro...

Please sign up or login with your details

Forgot password? Click here to reset