
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization
The successes of deep learning critically rely on the ability of neural ...
read it

Teaching with Commentaries
Effective training of deep neural networks can be challenging, and there...
read it

Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depth
A key factor in the success of deep neural networks is the ability to sc...
read it

Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics
A central challenge in developing versatile machine learning systems is ...
read it

A Survey of Deep Learning for Scientific Discovery
Over the past few years, we have seen fundamental breakthroughs in core ...
read it

Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML
An important research direction in machine learning has centered around ...
read it

The Algorithmic Automation Problem: Prediction, Triage, and Human Effort
In a wide array of areas, algorithms are matching and surpassing the per...
read it

Transfusion: Understanding Transfer Learning with Applications to Medical Imaging
With the increasingly varied applications of deep learning, transfer lea...
read it

Direct Uncertainty Prediction with Applications to Healthcare
Large labeled datasets for supervised learning are frequently constructe...
read it

Insights on representational similarity in neural networks with canonical correlation
Comparing different neural network representations and determining how r...
read it

Adversarial Spheres
State of the art computer vision models have been shown to be vulnerable...
read it

Can Deep Reinforcement Learning Solve ErdosSelfridgeSpencer Games?
Deep reinforcement learning has achieved many recent successes, but our ...
read it

SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability
We propose a new technique, Singular Vector Canonical Correlation Analys...
read it

Linear Additive Markov Processes
We introduce LAMP: the Linear Additive Markov Process. Transitions in LA...
read it

Survey of Expressivity in Deep Neural Networks
We survey results on neural network expressivity described in "On the Ex...
read it

Exponential expressivity in deep neural networks through transient chaos
We combine Riemannian geometry with the mean field theory of high dimens...
read it

On the Expressive Power of Deep Neural Networks
We propose a new approach to the problem of neural network expressivity,...
read it
Maithra Raghu
is this you? claim profile