Learning Hierarchically-Structured Concepts II: Overlapping Concepts, and Networks With Feedback

04/19/2023
by   Nancy Lynch, et al.
0

We continue our study from Lynch and Mallmann-Trenn (Neural Networks, 2021), of how concepts that have hierarchical structure might be represented in brain-like neural networks, how these representations might be used to recognize the concepts, and how these representations might be learned. In Lynch and Mallmann-Trenn (Neural Networks, 2021), we considered simple tree-structured concepts and feed-forward layered networks. Here we extend the model in two ways: we allow limited overlap between children of different concepts, and we allow networks to include feedback edges. For these more general cases, we describe and analyze algorithms for recognition and algorithms for learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/10/2019

Learning Hierarchically Structured Concepts

We study the question of how concepts that have structure get represente...
research
06/13/2017

Transfer entropy-based feedback improves performance in artificial neural networks

The structure of the majority of modern deep neural networks is characte...
research
09/21/2021

Multiblock-Networks: A Neural Network Analog to Component Based Methods for Multi-Source Data

Training predictive models on datasets from multiple sources is a common...
research
10/05/2017

Stacked Structure Learning for Lifted Relational Neural Networks

Lifted Relational Neural Networks (LRNNs) describe relational domains us...
research
10/26/2021

Bootstrapping Concept Formation in Small Neural Networks

The question how neural systems (of humans) can perform reasoning is sti...
research
02/08/2022

Modeling Structure with Undirected Neural Networks

Neural networks are powerful function estimators, leading to their statu...
research
11/17/2021

Acquisition of Chess Knowledge in AlphaZero

What is learned by sophisticated neural network agents such as AlphaZero...

Please sign up or login with your details

Forgot password? Click here to reset