An empirical study of the relation between network architecture and complexity

11/11/2019
by   Emir Konuk, et al.
0

In this preregistration submission, we propose an empirical study of how networks handle changes in complexity of the data. We investigate the effect of network capacity on generalization performance in the face of increasing data complexity. For this, we measure the generalization error for an image classification task where the number of classes steadily increases. We compare a number of modern architectures at different scales in this setting. The methodology, setup, and hypotheses described in this proposal were evaluated by peer review before experiments were conducted.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2020

Model-Agnostic Learning to Meta-Learn

In this paper, we propose a learning algorithm that enables a model to q...
research
02/03/2019

An Empirical Study on Regularization of Deep Neural Networks by Local Rademacher Complexity

Regularization of Deep Neural Networks (DNNs) for the sake of improving ...
research
02/23/2018

Sensitivity and Generalization in Neural Networks: an Empirical Study

In practice it is often found that large over-parameterized neural netwo...
research
02/16/2022

On Measuring Excess Capacity in Neural Networks

We study the excess capacity of deep networks in the context of supervis...
research
05/26/2015

An Empirical Evaluation of Current Convolutional Architectures' Ability to Manage Nuisance Location and Scale Variability

We conduct an empirical study to test the ability of Convolutional Neura...
research
07/27/2020

A Closer Look at Art Mediums: The MAMe Image Classification Dataset

Art is an expression of human creativity, skill and technology. An excep...
research
03/29/2022

Empirical Standards for Repository Mining

The purpose of scholarly peer review is to evaluate the quality of scien...

Please sign up or login with your details

Forgot password? Click here to reset