Implicit Generation and Generalization in Energy-Based Models

03/20/2019
by   Yilun Du, et al.
6

Energy based models (EBMs) are appealing due to their generality and simplicity in likelihood modeling, but have been traditionally difficult to train. We present techniques to scale MCMC based EBM training, on continuous neural networks, and show its success on the high-dimensional data domains of ImageNet32x32, ImageNet128x128, CIFAR-10, and robotic hand trajectories, achieving significantly better samples than other likelihood models and on par with contemporary GAN approaches, while covering all modes of the data. We highlight unique capabilities of implicit generation, such as energy compositionality and corrupt image reconstruction and completion. Finally, we show that EBMs generalize well and are able to achieve state-of-the-art out-of-distribution classification, exhibit adversarially robust classification, coherent long term predicted trajectory roll-outs, and generate zero-shot compositions of models.

READ FULL TEXT

page 4

page 5

page 6

page 8

page 9

page 11

page 12

page 13

research
10/08/2020

No MCMC for me: Amortized sampling for fast and stable training of energy-based models

Energy-Based Models (EBMs) present a flexible and appealing way to repre...
research
03/08/2023

M-EBM: Towards Understanding the Manifolds of Energy-Based Models

Energy-based models (EBMs) exhibit a variety of desirable properties in ...
research
02/01/2023

Versatile Energy-Based Models for High Energy Physics

Energy-based models have the natural advantage of flexibility in the for...
research
07/12/2022

Conditional Energy-Based Models for Implicit Policies: The Gap between Theory and Practice

We present our findings in the gap between theory and practice of using ...
research
01/28/2023

Controlling Steering with Energy-Based Models

So-called implicit behavioral cloning with energy-based models has shown...
research
09/11/2023

Revisiting Energy Based Models as Policies: Ranking Noise Contrastive Estimation and Interpolating Energy Models

A crucial design decision for any robot learning pipeline is the choice ...
research
03/17/2020

Energy-Based Processes for Exchangeable Data

Recently there has been growing interest in modeling sets with exchangea...

Please sign up or login with your details

Forgot password? Click here to reset