DeepAI
Log In Sign Up

Theory of Generative Deep Learning : Probe Landscape of Empirical Error via Norm Based Capacity Control

10/03/2018
by   Wendi Xu, et al.
0

Despite its remarkable empirical success as a highly competitive branch of artificial intelligence, deep learning is often blamed for its widely known low interpretation and lack of firm and rigorous mathematical foundation. However, most theoretical endeavor is devoted in discriminative deep learning case, whose complementary part is generative deep learning. To the best of our knowledge, we firstly highlight landscape of empirical error in generative case to complete the full picture through exquisite design of image super resolution under norm based capacity control. Our theoretical advance in interpretation of the training dynamic is achieved from both mathematical and biological sides.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/03/2018

Towards WARSHIP: Combining Components of Brain-Inspired Computing of RSH for Image Super Resolution

Evolution of deep learning shows that some algorithmic tricks are more d...
03/28/2017

Theory II: Landscape of the Empirical Risk in Deep Learning

Previous theoretical work on deep learning and neural network optimizati...
02/21/2021

Tchebichef Transform Domain-based Deep Learning Architecture for Image Super-resolution

The recent outbreak of COVID-19 has motivated researchers to contribute ...
08/09/2018

Deep Learning for Single Image Super-Resolution: A Brief Review

Single image super-resolution (SISR) is a notoriously challenging ill-po...
10/14/2022

ISTA-Inspired Network for Image Super-Resolution

Deep learning for image super-resolution (SR) has been investigated by n...
06/05/2018

Adaptive Importance Learning for Improving Lightweight Image Super-resolution Network

Deep neural networks have achieved remarkable success in single image su...