Pedagogical learning

11/26/2017
by   Long Ouyang, et al.
0

A common assumption in machine learning is that training data are i.i.d. samples from some distribution. Processes that generate i.i.d. samples are, in a sense, uninformative---they produce data without regard to how good this data is for learning. By contrast, cognitive science research has shown that when people generate training data for others (i.e., teaching), they deliberately select examples that are helpful for learning. Because the data is more informative, learning can require less data. Interestingly, such examples are most effective when learners know that the data were pedagogically generated (as opposed to randomly generated). We call this pedagogical learning---when a learner assumes that evidence comes from a helpful teacher. In this work, we ask how pedagogical learning might work for machine learning algorithms. Studying this question requires understanding how people actually teach complex concepts with examples, so we conducted a behavioral study examining how people teach regular expressions using example strings. We found that teachers' examples contain powerful clustering structure that can greatly facilitate learning. We then develop a model of teaching and show a proof of concept that using this model inside of a learner can improve performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2022

Iterative Teaching by Data Hallucination

We consider the problem of iterative machine teaching, where a teacher s...
research
09/05/2020

Using Machine Teaching to Investigate Human Assumptions when Teaching Reinforcement Learners

Successful teaching requires an assumption of how the learner learns - h...
research
03/21/2020

Understanding the Power and Limitations of Teaching with Imperfect Knowledge

Machine teaching studies the interaction between a teacher and a student...
research
10/27/2021

Iterative Teaching by Label Synthesis

In this paper, we consider the problem of iterative machine teaching, wh...
research
03/14/2019

Teaching with IMPACT

Like many problems in AI in their general form, supervised learning is c...
research
06/16/2021

Making Sense of Learning Log Data

Research is constantly engaged in finding more productive and powerful w...
research
06/30/2023

Machine learning for potion development at Hogwarts

Objective: To determine whether machine learning methods can generate us...

Please sign up or login with your details

Forgot password? Click here to reset