Pupil Learning Mechanism

07/30/2023
by   Rua-Huan Tsaih, et al.
0

Studies on artificial neural networks rarely address both vanishing gradients and overfitting issues. In this study, we follow the pupil learning procedure, which has the features of interpreting, picking, understanding, cramming, and organizing, to derive the pupil learning mechanism (PLM) by which to modify the network structure and weights of 2-layer neural networks (2LNNs). The PLM consists of modules for sequential learning, adaptive learning, perfect learning, and less-overfitted learning. Based upon a copper price forecasting dataset, we conduct an experiment to validate the PLM module design modules, and an experiment to evaluate the performance of PLM. The empirical results indeed approve the PLM module design and show the superiority of the proposed PLM model over the linear regression model and the conventional backpropagation-based 2LNN model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/18/2020

Neural networks in day-ahead electricity price forecasting: Single vs. multiple outputs

Recent advancements in the fields of artificial intelligence and machine...
research
11/12/2020

Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic Forgetting

Deep learning is often criticized by two serious issues which rarely exi...
research
08/14/2022

Gradient Mask: Lateral Inhibition Mechanism Improves Performance in Artificial Neural Networks

Lateral inhibitory connections have been observed in the cortex of the b...
research
05/27/2019

Structure Learning for Neural Module Networks

Neural Module Networks, originally proposed for the task of visual quest...
research
01/03/2023

Detecting Information Relays in Deep Neural Networks

Deep learning of artificial neural networks (ANNs) is creating highly fu...
research
02/21/2019

Topology of Learning in Artificial Neural Networks

Understanding how neural networks learn remains one of the central chall...
research
01/12/2017

Modularized Morphing of Neural Networks

In this work we study the problem of network morphism, an effective lear...

Please sign up or login with your details

Forgot password? Click here to reset