Exchangeable Variable Models

05/02/2014
by   Mathias Niepert, et al.
0

A sequence of random variables is exchangeable if its joint distribution is invariant under variable permutations. We introduce exchangeable variable models (EVMs) as a novel class of probabilistic models whose basic building blocks are partially exchangeable sequences, a generalization of exchangeable sequences. We prove that a family of tractable EVMs is optimal under zero-one loss for a large class of functions, including parity and threshold functions, and strictly subsumes existing tractable independence-based model families. Extensive experiments show that EVMs outperform state of the art classifiers such as SVMs and probabilistic models which are solely based on independence assumptions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2021

Exchangeability-Aware Sum-Product Networks

Sum-Product Networks (SPNs) are expressive probabilistic models that pro...
research
01/07/2014

Tractability through Exchangeability: A New Perspective on Efficient Probabilistic Inference

Exchangeability is a central notion in statistics and probability theory...
research
02/19/2021

Probabilistic Generating Circuits

Generating functions, which are widely used in combinatorics and probabi...
research
09/08/2016

Latent Dependency Forest Models

Probabilistic modeling is one of the foundations of modern machine learn...
research
08/16/2021

First-Order Theory of Probabilistic Independence and Single-Letter Characterizations of Capacity Regions

We consider the first-order theory of random variables with the probabil...
research
06/11/2018

Growing Better Graphs With Latent-Variable Probabilistic Graph Grammars

Recent work in graph models has found that probabilistic hyperedge repla...

Please sign up or login with your details

Forgot password? Click here to reset