Trusted Artificial Intelligence: Towards Certification of Machine Learning Applications

by   Philip Matthias Winter, et al.

Artificial Intelligence is one of the fastest growing technologies of the 21st century and accompanies us in our daily lives when interacting with technical applications. However, reliance on such technical systems is crucial for their widespread applicability and acceptance. The societal tools to express reliance are usually formalized by lawful regulations, i.e., standards, norms, accreditations, and certificates. Therefore, the TÜV AUSTRIA Group in cooperation with the Institute for Machine Learning at the Johannes Kepler University Linz, proposes a certification process and an audit catalog for Machine Learning applications. We are convinced that our approach can serve as the foundation for the certification of applications that use Machine Learning and Deep Learning, the techniques that drive the current revolution in Artificial Intelligence. While certain high-risk areas, such as fully autonomous robots in workspaces shared with humans, are still some time away from certification, we aim to cover low-risk applications with our certification procedure. Our holistic approach attempts to analyze Machine Learning applications from multiple perspectives to evaluate and verify the aspects of secure software development, functional requirements, data quality, data protection, and ethics. Inspired by existing work, we introduce four criticality levels to map the criticality of a Machine Learning application regarding the impact of its decisions on people, environment, and organizations. Currently, the audit catalog can be applied to low-risk applications within the scope of supervised learning as commonly encountered in industry. Guided by field experience, scientific developments, and market demands, the audit catalog will be extended and modified accordingly.


page 1

page 11

page 13

page 15

page 16

page 18

page 20


Artificial Intelligence and Machine Learning in Nuclear Physics

Advances in artificial intelligence/machine learning methods provide too...


This manuscript is technical memoir about my work at Stanford and Micros...

Latest Trends in Artificial Intelligence Technology: A Scoping Review

Artificial intelligence is more ubiquitous in multiple domains. Smartpho...

Forbidden knowledge in machine learning – Reflections on the limits of research and publication

Certain research strands can yield "forbidden knowledge". This term refe...

Survey on Automated Machine Learning

Machine learning has become a vital part in many aspects of our daily li...

Towards Generalizable Data Protection With Transferable Unlearnable Examples

Artificial Intelligence (AI) is making a profound impact in almost every...

Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure

Rising concern for the societal implications of artificial intelligence ...

Please sign up or login with your details

Forgot password? Click here to reset