DeepAI AI Chat
Log In Sign Up

Predicting Generalization in Deep Learning via Metric Learning – PGDL Shared task

by   Sebastian Mežnar, et al.

The competition "Predicting Generalization in Deep Learning (PGDL)" aims to provide a platform for rigorous study of generalization of deep learning models and offer insight into the progress of understanding and explaining these models. This report presents the solution that was submitted by the user smeznar which achieved the eight place in the competition. In the proposed approach, we create simple metrics and find their best combination with automatic testing on the provided dataset, exploring how combinations of various properties of the input neural network architectures can be used for the prediction of their generalization.


page 1

page 2

page 3

page 4


Fractal Dimension Generalization Measure

Developing a robust generalization measure for the performance of machin...

NeurIPS 2020 Competition: Predicting Generalization in Deep Learning

Understanding generalization in deep learning is arguably one of the mos...

Robustness to Augmentations as a Generalization metric

Generalization is the ability of a model to predict on unseen domains an...

Predicting Deep Neural Network Generalization with Perturbation Response Curves

The field of Deep Learning is rich with empirical evidence of human-like...

Ranking Deep Learning Generalization using Label Variation in Latent Geometry Graphs

Measuring the generalization performance of a Deep Neural Network (DNN) ...

Predicting Generalization in Deep Learning via Local Measures of Distortion

We study generalization in deep learning by appealing to complexity meas...

Automatic salt deposits segmentation: A deep learning approach

One of the most important applications of seismic reflection is the hydr...