Gaussian Experts Selection using Graphical Models

02/02/2021
by   Hamed Jalali, et al.
8

Local approximations are popular methods to scale Gaussian processes (GPs) to big data. Local approximations reduce time complexity by dividing the original dataset into subsets and training a local expert on each subset. Aggregating the experts' prediction is done assuming either conditional dependence or independence between the experts. Imposing the conditional independence assumption (CI) between the experts renders the aggregation of different expert predictions time efficient at the cost of poor uncertainty quantification. On the other hand, modeling dependent experts can provide precise predictions and uncertainty quantification at the expense of impractically high computational costs. By eliminating weak experts via a theory-guided expert selection step, we substantially reduce the computational cost of aggregating dependent experts while ensuring calibrated uncertainty quantification. We leverage techniques from the literature on undirected graphical models, using sparse precision matrices that encode conditional dependencies between experts to select the most important experts. Moreov

READ FULL TEXT

page 6

page 17

research
10/17/2020

Aggregating Dependent Gaussian Experts in Local Approximation

Distributed Gaussian processes (DGPs) are prominent local approximation ...
research
02/14/2021

Healing Products of Gaussian Processes

Gaussian processes (GPs) are nonparametric Bayesian models that have bee...
research
11/17/2022

Expert Selection in Distributed Gaussian Processes: A Multi-label Classification Approach

By distributing the training process, local approximation reduces the co...
research
02/07/2022

Gaussian Graphical Models as an Ensemble Method for Distributed Gaussian Processes

Distributed Gaussian process (DGP) is a popular approach to scale GP to ...
research
08/31/2020

Uncertainty quantification for Markov Random Fields

We present an information-based uncertainty quantification method for ge...
research
11/23/2021

Aggregation of Models, Choices, Beliefs, and Preferences

A natural notion of rationality/consistency for aggregating models is th...
research
09/02/2019

Soft Triangles for Expert Aggregation

We consider the problem of eliciting expert assessments of an uncertain ...

Please sign up or login with your details

Forgot password? Click here to reset