Log In Sign Up

Theory of Generative Deep Learning : Probe Landscape of Empirical Error via Norm Based Capacity Control

by   Wendi Xu, et al.

Despite its remarkable empirical success as a highly competitive branch of artificial intelligence, deep learning is often blamed for its widely known low interpretation and lack of firm and rigorous mathematical foundation. However, most theoretical endeavor is devoted in discriminative deep learning case, whose complementary part is generative deep learning. To the best of our knowledge, we firstly highlight landscape of empirical error in generative case to complete the full picture through exquisite design of image super resolution under norm based capacity control. Our theoretical advance in interpretation of the training dynamic is achieved from both mathematical and biological sides.


page 1

page 2

page 3

page 4


Towards WARSHIP: Combining Components of Brain-Inspired Computing of RSH for Image Super Resolution

Evolution of deep learning shows that some algorithmic tricks are more d...

Theory II: Landscape of the Empirical Risk in Deep Learning

Previous theoretical work on deep learning and neural network optimizati...

Tchebichef Transform Domain-based Deep Learning Architecture for Image Super-resolution

The recent outbreak of COVID-19 has motivated researchers to contribute ...

Deep Learning for Single Image Super-Resolution: A Brief Review

Single image super-resolution (SISR) is a notoriously challenging ill-po...

ISTA-Inspired Network for Image Super-Resolution

Deep learning for image super-resolution (SR) has been investigated by n...

Adaptive Importance Learning for Improving Lightweight Image Super-resolution Network

Deep neural networks have achieved remarkable success in single image su...