Mental Models of Adversarial Machine Learning

05/08/2021
by   Lukas Bieringer, et al.
0

Although machine learning (ML) is widely used in practice, little is known about practitioners' actual understanding of potential security challenges. In this work, we close this substantial gap in the literature and contribute a qualitative study focusing on developers' mental models of the ML pipeline and potentially vulnerable components. Studying mental models has helped in other security fields to discover root causes or improve risk communication. Our study reveals four characteristic ranges in mental models of industrial practitioners. The first range concerns the intertwined relationship of adversarial machine learning (AML) and classical security. The second range describes structural and functional components. The third range expresses individual variations of mental models, which are neither explained by the application nor by the educational background of the corresponding subjects. The fourth range corresponds to the varying levels of technical depth, which are however not determined by our subjects' level of knowledge. Our characteristic ranges have implications for the integration of AML into corporate workflows, security enhancing tools for practitioners, and creating appropriate regulatory frameworks for AML.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/18/2020

Usable Security for ML Systems in Mental Health: A Framework

While the applications and demands of Machine learning (ML) systems in m...
research
07/13/2020

Security and Machine Learning in the Real World

Machine learning (ML) models deployed in many safety- and business-criti...
research
03/20/2022

The Dark Side: Security Concerns in Machine Learning for EDA

The growing IC complexity has led to a compelling need for design effici...
research
02/18/2022

Symphony: Composing Interactive Interfaces for Machine Learning

Interfaces for machine learning (ML), information and visualizations abo...
research
07/17/2018

Sonification in security operations centres: what do security practitioners think?

In Security Operations Centres (SOCs) security practitioners work using ...
research
07/11/2022

"Why do so?" – A Practical Perspective on Machine Learning Security

Despite the large body of academic work on machine learning security, li...
research
07/21/2021

Automated Identification of Security Discussions in Microservices Systems: Industrial Surveys and Experiments

Lack of awareness and knowledge of microservices-specific security chall...

Please sign up or login with your details

Forgot password? Click here to reset