Learning from AI: An Interactive Learning Method Using a DNN Model Incorporating Expert Knowledge as a Teacher

06/04/2023
by   Kohei Hattori, et al.
9

Visual explanation is an approach for visualizing the grounds of judgment by deep learning, and it is possible to visually interpret the grounds of a judgment for a certain input by visualizing an attention map. As for deep-learning models that output erroneous decision-making grounds, a method that incorporates expert human knowledge in the model via an attention map in a manner that improves explanatory power and recognition accuracy is proposed. In this study, based on a deep-learning model that incorporates the knowledge of experts, a method by which a learner "learns from AI" the grounds for its decisions is proposed. An "attention branch network" (ABN), which has been fine-tuned with attention maps modified by experts, is prepared as a teacher. By using an interactive editing tool for the fine-tuned ABN and attention maps, the learner learns by editing the attention maps and changing the inference results. By repeatedly editing the attention maps and making inferences so that the correct recognition results are output, the learner can acquire the grounds for the expert's judgments embedded in the ABN. The results of an evaluation experiment with subjects show that learning using the proposed method is more efficient than the conventional method.

READ FULL TEXT

page 6

page 9

research
05/09/2019

Embedding Human Knowledge in Deep Neural Network via Attention Map

Human-in-the-loop (HITL), which introduces human knowledge to machine le...
research
08/18/2022

Visual Explanation of Deep Q-Network for Robot Navigation by Fine-tuning Attention Branch

Robot navigation with deep reinforcement learning (RL) achieves higher p...
research
12/06/2021

Making a Bird AI Expert Work for You and Me

As powerful as fine-grained visual classification (FGVC) is, responding ...
research
10/13/2019

Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT

Despite recent advances in the application of deep learning algorithms t...
research
06/13/2022

Efficient Human-in-the-loop System for Guiding DNNs Attention

Attention guidance is an approach to addressing dataset bias in deep lea...
research
03/23/2017

Quality Resilient Deep Neural Networks

We study deep neural networks for classification of images with quality ...
research
11/10/2019

Modelling Bahdanau Attention using Election methods aided by Q-Learning

Neural Machine Translation has lately gained a lot of "attention" with t...

Please sign up or login with your details

Forgot password? Click here to reset