Machine Learning Models Disclosure from Trusted Research Environments (TRE), Challenges and Opportunities

by   Esma Mansouri-Benssassi, et al.

Trusted Research environments (TRE)s are safe and secure environments in which researchers can access sensitive data. With the growth and diversity of medical data such as Electronic Health Records (EHR), Medical Imaging and Genomic data, there is an increase in the use of Artificial Intelligence (AI) in general and the subfield of Machine Learning (ML) in particular in the healthcare domain. This generates the desire to disclose new types of outputs from TREs, such as trained machine learning models. Although specific guidelines and policies exists for statistical disclosure controls in TREs, they do not satisfactorily cover these new types of output request. In this paper, we define some of the challenges around the application and disclosure of machine learning for healthcare within TREs. We describe various vulnerabilities the introduction of AI brings to TREs. We also provide an introduction to the different types and levels of risks associated with the disclosure of trained ML models. We finally describe the new research opportunities in developing and adapting policies and tools for safely disclosing machine learning outputs from TREs.



There are no comments yet.


page 17


Opportunities in Machine Learning for Healthcare

Healthcare is a natural arena for the application of machine learning, e...

ISTHMUS: Secure, Scalable, Real-time and Robust Machine Learning Platform for Healthcare

In recent times, machine learning (ML) and artificial intelligence (AI) ...

Trusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed Learning

Motivated by the advancing computational capacity of distributed end-use...

Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluation

Detection of Out-of-Distribution (OOD) samples in real time is a crucial...

The Future AI in Healthcare: A Tsunami of False Alarms or a Product of Experts?

Recent significant increases in affordable and accessible computational ...

Healthsheet: Development of a Transparency Artifact for Health Datasets

Machine learning (ML) approaches have demonstrated promising results in ...

Polymer Informatics: Current Status and Critical Next Steps

Artificial intelligence (AI) based approaches are beginning to impact se...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.