AI Chat AI Image Generator AI Video Text to Speech

Norm-Based Capacity Control in Neural Networks

02/27/2015

∙

by Behnam Neyshabur, et al.

∙

∙

We investigate the capacity, convexity and characterization of a general family of norm-constrained feed-forward networks.

Behnam Neyshabur
42 publications
Ryota Tomioka
32 publications
Nathan Srebro
96 publications

page 1

page 2

page 3

page 4

research

∙ 06/09/2022

A general approximation lower bound in L^p norm, with applications to feed-forward neural networks

We study the fundamental limits to the expressive power of neural networ...

0 El Mehdi Achour, et al. ∙

research

∙ 11/05/2017

Fisher-Rao Metric, Geometry, and Complexity of Neural Networks

We study the relationship between geometry and capacity measures for dee...

0 Tengyuan Liang, et al. ∙

research

∙ 02/03/2010

Using CODEQ to Train Feed-forward Neural Networks

CODEQ is a new, population-based meta-heuristic algorithm that is a hybr...

0 Mahamed G. H. Omran, et al. ∙

research

∙ 06/11/2019

Neural network identifiability for a family of sigmoidal nonlinearities

This paper addresses the following question of neural network identifiab...

0 Verner Vlačić, et al. ∙

research

∙ 08/19/2022

Kernel Memory Networks: A Unifying Framework for Memory Modeling

We consider the problem of training a neural network to store a set of p...

0 Georgios Iatropoulos, et al. ∙

research

∙ 03/15/2020

A model of figure ground organization incorporating local and global cues

Figure Ground Organization (FGO) – inferring spatial depth ordering of o...

1 Sudarshan Ramenahalli, et al. ∙

research

∙ 10/19/2020

Parameter Norm Growth During Training of Transformers

The capacity of neural networks like the widely adopted transformer is k...

0 William Merrill, et al. ∙