Knowledge-guided Semantic Computing Network

09/29/2018
by   Guangming Shi, et al.
0

It is very useful to integrate human knowledge and experience into traditional neural networks for faster learning speed, fewer training samples and better interpretability. However, due to the obscured and indescribable black box model of neural networks, it is very difficult to design its architecture, interpret its features and predict its performance. Inspired by human visual cognition process, we propose a knowledge-guided semantic computing network which includes two modules: a knowledge-guided semantic tree and a data-driven neural network. The semantic tree is pre-defined to describe the spatial structural relations of different semantics, which just corresponds to the tree-like description of objects based on human knowledge. The object recognition process through the semantic tree only needs simple forward computing without training. Besides, to enhance the recognition ability of the semantic tree in aspects of the diversity, randomicity and variability, we use the traditional neural network to aid the semantic tree to learn some indescribable features. Only in this case, the training process is needed. The experimental results on MNIST and GTSRB datasets show that compared with the traditional data-driven network, our proposed semantic computing network can achieve better performance with fewer training samples and lower computational complexity. Especially, Our model also has better adversarial robustness than traditional neural network with the help of human knowledge.

READ FULL TEXT

page 5

page 6

page 8

page 11

page 12

research
11/08/2021

SEGA: Semantic Guided Attention on Visual Prototype for Few-Shot Learning

Teaching machines to recognize a new category based on few training samp...
research
02/19/2015

Unsupervised Network Pretraining via Encoding Human Design

Over the years, computer vision researchers have spent an immense amount...
research
04/15/2022

Synthesizing Informative Training Samples with GAN

Remarkable progress has been achieved in synthesizing photo-realistic im...
research
02/22/2021

Approximation of dilation-based spatial relations to add structural constraints in neural networks

Spatial relations between objects in an image have proved useful for str...
research
04/03/2022

DST: Dynamic Substitute Training for Data-free Black-box Attack

With the wide applications of deep neural network models in various comp...
research
05/19/2023

Constructing Word-Context-Coupled Space Aligned with Associative Knowledge Relations for Interpretable Language Modeling

As the foundation of current natural language processing methods, pre-tr...
research
07/24/2022

Hyperdimensional Computing vs. Neural Networks: Comparing Architecture and Learning Process

Hyperdimensional Computing (HDC) has obtained abundant attention as an e...

Please sign up or login with your details

Forgot password? Click here to reset