DeepAI AI Chat
Log In Sign Up

Concept Embedding Analysis: A Review

03/25/2022
by   Gesina Schwalbe, et al.
Continental
0

Deep neural networks (DNNs) have found their way into many applications with potential impact on the safety, security, and fairness of human-machine-systems. Such require basic understanding and sufficient trust by the users. This motivated the research field of explainable artificial intelligence (XAI), i.e. finding methods for opening the "black-boxes" DNNs represent. For the computer vision domain in specific, practical assessment of DNNs requires a globally valid association of human interpretable concepts with internals of the model. The research field of concept (embedding) analysis (CA) tackles this problem: CA aims to find global, assessable associations of humanly interpretable semantic concepts (e.g., eye, bearded) with internal representations of a DNN. This work establishes a general definition of CA and a taxonomy for CA methods, uniting several ideas from literature. That allows to easily position and compare CA approaches. Guided by the defined notions, the current state-of-the-art research regarding CA methods and interesting applications are reviewed. More than thirty relevant methods are discussed, compared, and categorized. Finally, for practitioners, a survey of fifteen datasets is provided that have been used for supervised concept analysis. Open challenges and research directions are pointed out at the end.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/24/2021

Towards Fully Interpretable Deep Neural Networks: Are We There Yet?

Despite the remarkable performance, Deep Neural Networks (DNNs) behave a...
12/07/2022

Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning

As the societal impact of Deep Neural Networks (DNNs) grows, the goals f...
03/30/2020

Architecture Disentanglement for Deep Neural Networks

Deep Neural Networks (DNNs) are central to deep learning, and understand...
05/09/2023

A Systematic Literature Review on Hardware Reliability Assessment Methods for Deep Neural Networks

Artificial Intelligence (AI) and, in particular, Machine Learning (ML) h...
10/01/2018

Benchmark Analysis of Representative Deep Neural Network Architectures

This work presents an in-depth analysis of the majority of the deep neur...
12/02/2022

SimpleMind adds thinking to deep neural networks

Deep neural networks (DNNs) detect patterns in data and have shown versa...
11/11/2022

Emergence of Concepts in DNNs?

The present paper reviews and discusses work from computer science that ...