Permutation Invariant Likelihoods and Equivariant Transformations

02/05/2019
by   Chris Bender, et al.
0

In this work, we fill a substantial void in machine learning and statistical methodology by developing extensive generative density estimation techniques for exchangeable non-iid data. We do so through the use of permutation invariant likelihoods and permutation equivariant transformations of variables. These methods exploit the intradependencies within sets in ways that are independent of ordering (for likelihoods) or order preserving (for transformations). The proposed techniques are able to directly model exchangeable data (such as sets) without the need to account for permutations or assume independence of elements. We consider applications to point clouds and provide several interesting experiments on both synthetic and real-world datasets.

READ FULL TEXT
research
10/25/2020

Regularizing Towards Permutation Invariance in Recurrent Models

In many machine learning problems the output should not depend on the or...
research
01/30/2018

Transformation Autoregressive Networks

The fundamental task of general density estimation has been of keen inte...
research
10/06/2020

On the Universality of Rotation Equivariant Point Cloud Networks

Learning functions on point clouds has applications in many fields, incl...
research
06/26/2020

Conditional Set Generation with Transformers

A set is an unordered collection of unique elements–and yet many machine...
research
09/06/2019

Set Flow: A Permutation Invariant Normalizing Flow

We present a generative model that is defined on finite sets of exchange...
research
11/27/2017

Classifier Selection with Permutation Tests

This work presents a content-based recommender system for machine learni...
research
07/17/2021

PICASO: Permutation-Invariant Cascaded Attentional Set Operator

Set-input deep networks have recently drawn much interest in computer vi...

Please sign up or login with your details

Forgot password? Click here to reset