Automatic Construction and Natural-Language Description of Nonparametric Regression Models

02/18/2014
by   James Robert Lloyd, et al.
0

This paper presents the beginnings of an automatic statistician, focusing on regression problems. Our system explores an open-ended space of statistical models to discover a good explanation of a data set, and then produces a detailed report with figures and natural-language text. Our approach treats unknown regression functions nonparametrically using Gaussian processes, which has two important consequences. First, Gaussian processes can model functions in terms of high-level properties (e.g. smoothness, trends, periodicity, changepoints). Taken together with the compositional structure of our language of models this allows us to automatically describe functions in simple terms. Second, the use of flexible nonparametric models and a rich language for composing them in an open-ended manner also results in state-of-the-art extrapolation performance evaluated over 13 real time series data sets from various domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/26/2015

The Automatic Statistician: A Relational Perspective

Gaussian Processes (GPs) provide a general and analytically tractable wa...
research
12/21/2018

GaussianProcesses.jl: A Nonparametric Bayes package for the Julia Language

Gaussian processes are a class of flexible nonparametric Bayesian tools ...
research
05/14/2019

Graph Convolutional Gaussian Processes

We propose a novel Bayesian nonparametric method to learn translation-in...
research
10/27/2015

Blitzkriging: Kronecker-structured Stochastic Gaussian Processes

We present Blitzkriging, a new approach to fast inference for Gaussian p...
research
11/23/2021

Application of Gaussian Processes to online approximation of compressor maps for load-sharing in a compressor station

Devising optimal operating strategies for a compressor station relies on...
research
06/08/2017

Scaling up the Automatic Statistician: Scalable Structure Discovery using Gaussian Processes

Automating statistical modelling is a challenging problem that has far-r...

Please sign up or login with your details

Forgot password? Click here to reset