
-
Teaching with Commentaries
Effective training of deep neural networks can be challenging, and there...
read it
-
Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depth
A key factor in the success of deep neural networks is the ability to sc...
read it
-
Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics
A central challenge in developing versatile machine learning systems is ...
read it
-
A Survey of Deep Learning for Scientific Discovery
Over the past few years, we have seen fundamental breakthroughs in core ...
read it
-
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML
An important research direction in machine learning has centered around ...
read it
-
The Algorithmic Automation Problem: Prediction, Triage, and Human Effort
In a wide array of areas, algorithms are matching and surpassing the per...
read it
-
Transfusion: Understanding Transfer Learning with Applications to Medical Imaging
With the increasingly varied applications of deep learning, transfer lea...
read it
-
Direct Uncertainty Prediction with Applications to Healthcare
Large labeled datasets for supervised learning are frequently constructe...
read it
-
Insights on representational similarity in neural networks with canonical correlation
Comparing different neural network representations and determining how r...
read it
-
Adversarial Spheres
State of the art computer vision models have been shown to be vulnerable...
read it
-
Can Deep Reinforcement Learning Solve Erdos-Selfridge-Spencer Games?
Deep reinforcement learning has achieved many recent successes, but our ...
read it
-
SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability
We propose a new technique, Singular Vector Canonical Correlation Analys...
read it
-
Linear Additive Markov Processes
We introduce LAMP: the Linear Additive Markov Process. Transitions in LA...
read it
-
Survey of Expressivity in Deep Neural Networks
We survey results on neural network expressivity described in "On the Ex...
read it
-
Exponential expressivity in deep neural networks through transient chaos
We combine Riemannian geometry with the mean field theory of high dimens...
read it
-
On the Expressive Power of Deep Neural Networks
We propose a new approach to the problem of neural network expressivity,...
read it