Towards a Measure of Trustworthiness to Evaluate CNNs During Operation

01/21/2023
by   Abanoub Ghobrial, et al.
0

Due to black box nature of Convolutional neural networks (CNNs), the continuous validation of CNN classifiers' during operation is infeasible. As a result this makes it difficult for developers or regulators to gain confidence in the deployment of autonomous systems employing CNNs. We introduce the trustworthiness in classification score (TCS), a metric to assist with overcoming this challenge. The metric quantifies the trustworthiness in a prediction by checking for the existence of certain features in the predictions made by the CNN. A case study on persons detection is used to to demonstrate our method and the usage of TCS.

READ FULL TEXT
research
09/11/2018

Visualizing Convolutional Neural Networks to Improve Decision Support for Skin Lesion Classification

Because of their state-of-the-art performance in computer vision, CNNs a...
research
10/06/2020

IS-CAM: Integrated Score-CAM for axiomatic-based explanations

Convolutional Neural Networks have been known as black-box models as hum...
research
07/07/2014

Analyzing the Performance of Multilayer Neural Networks for Object Recognition

In the last two years, convolutional neural networks (CNNs) have achieve...
research
09/18/2014

Deformable Part Models are Convolutional Neural Networks

Deformable part models (DPMs) and convolutional neural networks (CNNs) a...
research
10/16/2022

Demystifying CNNs for Images by Matched Filters

The success of convolution neural networks (CNN) has been revolutionisin...
research
12/20/2019

Analysis of Video Feature Learning in Two-Stream CNNs on the Example of Zebrafish Swim Bout Classification

Semmelhack et al. (2014) have achieved high classification accuracy in d...
research
04/03/2023

D-Score: A White-Box Diagnosis Score for CNNs Based on Mutation Operators

Convolutional neural networks (CNNs) have been widely applied in many sa...

Please sign up or login with your details

Forgot password? Click here to reset