Bridging Maximum Likelihood and Adversarial Learning via α-Divergence

by   Miaoyun Zhao, et al.

Maximum likelihood (ML) and adversarial learning are two popular approaches for training generative models, and from many perspectives these techniques are complementary. ML learning encourages the capture of all data modes, and it is typically characterized by stable training. However, ML learning tends to distribute probability mass diffusely over the data space, e.g., yielding blurry synthetic images. Adversarial learning is well known to synthesize highly realistic natural images, despite practical challenges like mode dropping and delicate training. We propose an α-Bridge to unify the advantages of ML and adversarial learning, enabling the smooth transfer from one to the other via the α-divergence. We reveal that generalizations of the α-Bridge are closely related to approaches developed recently to regularize adversarial learning, providing insights into that prior work, and further understanding of why the α-Bridge performs well in practice.



page 7

page 16

page 17

page 18

page 19


Semi-Implicit Generative Model

To combine explicit and implicit generative models, we introduce semi-im...

A Brief Introduction to Generative Models

We introduce and motivate generative modeling as a central task for mach...

Adversarial Learning of a Sampler Based on an Unnormalized Distribution

We investigate adversarial learning in the case when only an unnormalize...

The Inductive Bias of Restricted f-GANs

Generative adversarial networks are a novel method for statistical infer...

Coverage and Quality Driven Training of Generative Image Models

Generative modeling of natural images has been extensively studied in re...

Solving Schrödinger Bridges via Maximum Likelihood

The Schrödinger bridge problem (SBP) finds the most likely stochastic ev...

A Survey of Adversarial Learning on Graphs

Deep learning models on graphs have achieved remarkable performance in v...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.