Knowledge Infused Learning (K-IL): Towards Deep Incorporation of Knowledge in Deep Learning

12/01/2019
by   Ugur Kursuncu, et al.
22

Learning the underlying patterns in the data goes beyond instance-based generalization to some external knowledge represented in structured graphs or networks. Deep Learning (DL) has shown significant advances in probabilistically learning latent patterns in the data using a multi-layered network of computational nodes (i.e. neurons/hidden units). However, with the tremendous amount of training data, uncertainty in generalization on domain-specific tasks, and delta improvement with an increase in complexity of models seem to raise a concern on the features learned by the model. As incorporation of domain specific knowledge will aid in supervising the learning of features for the model, infusion of knowledge from knowledge graphs within hidden layers will further enhance the learning process. Although much work remains, we believe that KGs will play an increasing role in developing hybrid neuro-symbolic intelligent systems (that is bottom up deep learning with top down symbolic computing) as well as in building explainable AI systems for which KGs will provide a scaffolding for punctuating neural computing. In this position paper, we describe our motivation for such hybrid approach and a framework that combines knowledge graph and neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2023

Knowledge-enhanced Neuro-Symbolic AI for Cybersecurity and Privacy

Neuro-Symbolic Artificial Intelligence (AI) is an emerging and quickly a...
research
10/23/2020

Incorporating Symbolic Domain Knowledge into Graph Neural Networks

Our interest is in scientific problems with the following characteristic...
research
09/21/2021

Learning through structure: towards deep neuromorphic knowledge graph embeddings

Computing latent representations for graph-structured data is an ubiquit...
research
10/13/2022

Graph-based Neural Modules to Inspect Attention-based Architectures: A Position Paper

Encoder-decoder architectures are prominent building blocks of state-of-...
research
03/01/2022

Dual Embodied-Symbolic Concept Representations for Deep Learning

Motivated by recent findings from cognitive neural science, we advocate ...
research
06/24/2015

Learning Representations from Deep Networks Using Mode Synthesizers

Deep learning Networks play a crucial role in the evolution of a vast nu...

Please sign up or login with your details

Forgot password? Click here to reset