The Human Kernel

10/26/2015
by   Andrew Gordon Wilson, et al.
0

Bayesian nonparametric models, such as Gaussian processes, provide a compelling framework for automatic statistical modelling: these models have a high degree of flexibility, and automatically calibrated complexity. However, automating human expertise remains elusive; for example, Gaussian processes with standard kernels struggle on function extrapolation problems that are trivial for human learners. In this paper, we create function extrapolation problems and acquire human responses, and then design a kernel learning framework to reverse engineer the inductive biases of human learners across a set of behavioral experiments. We use the learned kernels to gain psychological insights and to extrapolate in human-like ways that go beyond traditional stationary and polynomial kernels. Finally, we investigate Occam's razor in human and Gaussian process based function learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2013

Gaussian Process Kernels for Pattern Discovery and Extrapolation

Gaussian processes are rich distributions over functions, which provide ...
research
04/01/2019

Sentiment analysis with genetically evolved Gaussian kernels

Sentiment analysis consists of evaluating opinions or statements from th...
research
11/10/2022

On power sum kernels on symmetric groups

In this note, we introduce a family of "power sum" kernels and the corre...
research
06/14/2021

Marginalising over Stationary Kernels with Bayesian Quadrature

Marginalising over families of Gaussian Process kernels produces flexibl...
research
10/29/2019

Function-Space Distributions over Kernels

Gaussian processes are flexible function approximators, with inductive b...
research
06/12/2018

Differentiable Compositional Kernel Learning for Gaussian Processes

The generalization properties of Gaussian processes depend heavily on th...
research
10/27/2016

Learning Scalable Deep Kernels with Recurrent Structure

Many applications in speech, robotics, finance, and biology deal with se...

Please sign up or login with your details

Forgot password? Click here to reset