Trustworthy AI Inference Systems: An Industry Research View

by   Rosario Cammarota, et al.

In this work, we provide an industry research view for approaching the design, deployment, and operation of trustworthy Artificial Intelligence (AI) inference systems. Such systems provide customers with timely, informed, and customized inferences to aid their decision, while at the same time utilizing appropriate security protection mechanisms for AI models. Additionally, such systems should also use Privacy-Enhancing Technologies (PETs) to protect customers' data at any time. To approach the subject, we start by introducing trends in AI inference systems. We continue by elaborating on the relationship between Intellectual Property (IP) and private data protection in such systems. Regarding the protection mechanisms, we survey the security and privacy building blocks instrumental in designing, building, deploying, and operating private AI inference systems. For example, we highlight opportunities and challenges in AI systems using trusted execution environments combined with more recent advances in cryptographic techniques to protect data in use. Finally, we outline areas of further development that require the global collective attention of industry, academia, and government researchers to sustain the operation of trustworthy AI inference systems.


page 1

page 2

page 3

page 4


Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims

With the recent wave of progress in artificial intelligence (AI) has com...

Trustworthy AI: From Principles to Practices

Fast developing artificial intelligence (AI) technology has enabled vari...

Disentangling private classes through regularization

Deep learning models are nowadays broadly deployed to solve an incredibl...

Building Bridges: Generative Artworks to Explore AI Ethics

In recent years, there has been an increased emphasis on understanding a...

AI for Closed-Loop Control Systems — New Opportunities for Modeling, Designing, and Tuning Control Systems

Control Systems, particularly closed-loop control systems (CLCS), are fr...

A Survey on Proactive Customer Care: Enabling Science and Steps to Realize it

In recent times, advances in artificial intelligence (AI) and IoT have e...