SimpleMind adds thinking to deep neural networks

12/02/2022
by   Youngwon Choi, et al.
0

Deep neural networks (DNNs) detect patterns in data and have shown versatility and strong performance in many computer vision applications. However, DNNs alone are susceptible to obvious mistakes that violate simple, common sense concepts and are limited in their ability to use explicit knowledge to guide their search and decision making. While overall DNN performance metrics may be good, these obvious errors, coupled with a lack of explainability, have prevented widespread adoption for crucial tasks such as medical image analysis. The purpose of this paper is to introduce SimpleMind, an open-source software framework for Cognitive AI focused on medical image understanding. It allows creation of a knowledge base that describes expected characteristics and relationships between image objects in an intuitive human-readable form. The SimpleMind framework brings thinking to DNNs by: (1) providing methods for reasoning with the knowledge base about image content, such as spatial inferencing and conditional reasoning to check DNN outputs; (2) applying process knowledge, in the form of general-purpose software agents, that are chained together to accomplish image preprocessing, DNN prediction, and result post-processing, and (3) performing automatic co-optimization of all knowledge base parameters to adapt agents to specific problems. SimpleMind enables reasoning on multiple detected objects to ensure consistency, providing cross checking between DNN outputs. This machine reasoning improves the reliability and trustworthiness of DNNs through an interpretable model and explainable decisions. Example applications are provided that demonstrate how SimpleMind supports and improves deep neural networks by embedding them within a Cognitive AI framework.

READ FULL TEXT

page 4

page 6

page 7

page 9

page 10

page 12

page 13

page 15

research
03/03/2021

Self-Checking Deep Neural Networks in Deployment

The widespread adoption of Deep Neural Networks (DNNs) in important doma...
research
10/25/2017

Deep Neural Networks

Deep Neural Networks (DNNs) are universal function approximators providi...
research
01/19/2022

Cognitive Explainers of Graph Neural Networks Based on Medical Concepts

Although deep neural networks (DNN) have achieved state-of-the-art perfo...
research
01/20/2021

A Search-Based Testing Framework for Deep Neural Networks of Source Code Embedding

Over the past few years, deep neural networks (DNNs) have been continuou...
research
03/25/2022

Concept Embedding Analysis: A Review

Deep neural networks (DNNs) have found their way into many applications ...
research
02/13/2023

Reliability Assurance for Deep Neural Network Architectures Against Numerical Defects

With the widespread deployment of deep neural networks (DNNs), ensuring ...
research
01/08/2017

Multi-Objective Software Suite of Two-Dimensional Shape Descriptors for Object-Based Image Analysis

In recent years two sets of planar (2D) shape attributes, provided with ...

Please sign up or login with your details

Forgot password? Click here to reset