Gaussian Experts Selection using Graphical Models

02/02/2021
by   Hamed Jalali, et al.
8

Local approximations are popular methods to scale Gaussian processes (GPs) to big data. Local approximations reduce time complexity by dividing the original dataset into subsets and training a local expert on each subset. Aggregating the experts' prediction is done assuming either conditional dependence or independence between the experts. Imposing the conditional independence assumption (CI) between the experts renders the aggregation of different expert predictions time efficient at the cost of poor uncertainty quantification. On the other hand, modeling dependent experts can provide precise predictions and uncertainty quantification at the expense of impractically high computational costs. By eliminating weak experts via a theory-guided expert selection step, we substantially reduce the computational cost of aggregating dependent experts while ensuring calibrated uncertainty quantification. We leverage techniques from the literature on undirected graphical models, using sparse precision matrices that encode conditional dependencies between experts to select the most important experts. Moreov

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

page 17

10/17/2020

Aggregating Dependent Gaussian Experts in Local Approximation

Distributed Gaussian processes (DGPs) are prominent local approximation ...
02/14/2021

Healing Products of Gaussian Processes

Gaussian processes (GPs) are nonparametric Bayesian models that have bee...
08/31/2020

Uncertainty quantification for Markov Random Fields

We present an information-based uncertainty quantification method for ge...
11/23/2021

Aggregation of Models, Choices, Beliefs, and Preferences

A natural notion of rationality/consistency for aggregating models is th...
07/17/2021

Model Uncertainty and Correctability for Directed Graphical Models

Probabilistic graphical models are a fundamental tool in probabilistic m...
09/02/2019

Soft Triangles for Expert Aggregation

We consider the problem of eliciting expert assessments of an uncertain ...
01/13/2020

Considering discrepancy when calibrating a mechanistic electrophysiology model

Uncertainty quantification (UQ) is a vital step in using mathematical mo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.