How Machine (Deep) Learning Helps Us Understand Human Learning: the Value of Big Ideas

02/16/2019
by   Marc Maliar, et al.
0

I use simulation of two multilayer neural networks to gain intuition into the determinants of human learning. The first network, the teacher, is trained to achieve a high accuracy in handwritten digit recognition. The second network, the student, learns to reproduce the output of the first network. I show that learning from the teacher is more effective than learning from the data under the appropriate degree of regularization. Regularization allows the teacher to distinguish the trends and to deliver "big ideas" to the student. I also model other learning situations such as expert and novice teachers, high- and low-ability students and biased learning experience due to, e.g., poverty and trauma. The results from computer simulation accord remarkably well with finding of the modern psychological literature. The code is written in MATLAB and will be publicly available from the author's web page.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2017

Interpretable and Pedagogical Examples

Teachers intentionally pick the most informative examples to show their ...
research
05/15/2018

Knowledge Distillation in Generations: More Tolerant Teachers Educate Better Students

This paper studies teacher-student optimization on neural networks, i.e....
research
06/11/2021

On Learnability via Gradient Method for Two-Layer ReLU Neural Networks in Teacher-Student Setting

Deep learning empirically achieves high performance in many applications...
research
05/16/2023

Low-complexity deep learning frameworks for acoustic scene classification using teacher-student scheme and multiple spectrograms

In this technical report, a low-complexity deep learning system for acou...
research
07/01/2020

Student-Teacher Curriculum Learning via Reinforcement Learning: Predicting Hospital Inpatient Admission Location

Accurate and reliable prediction of hospital admission location is impor...
research
02/28/2017

Scaffolding Networks: Incremental Learning and Teaching Through Questioning

We introduce a new paradigm of learning for reasoning, understanding, an...
research
02/15/2023

Spatially heterogeneous learning by a deep student machine

Despite the spectacular successes, deep neural networks (DNN) with a hug...

Please sign up or login with your details

Forgot password? Click here to reset