research
∙
01/13/2023
RxRx1: A Dataset for Evaluating Experimental Batch Correction Methods
High-throughput screening techniques are commonly used to obtain large q...
share
research
∙
09/16/2021
Language Models are Few-shot Multilingual Learners
General-purpose language models have demonstrated impressive capabilitie...
research
∙
07/16/2021
When does loss-based prioritization fail?
Not all examples are created equal, but standard deep neural network tra...
research
∙
06/26/2020
Supermasks in Superposition
We present the Supermasks in Superposition (SupSup) model, capable of se...
research
∙
02/21/2020
Estimating Q(s,s') with Deep Deterministic Dynamics Gradients
In this paper, we introduce a novel form of value function, Q(s, s'), th...
research
∙
12/04/2019
Plug and Play Language Models: a Simple Approach to Controlled Text Generation
Large transformer-based language models (LMs) trained on huge text corpo...
research
∙
10/18/2019
First-Order Preconditioning via Hypergradient Descent
Standard gradient descent methods are susceptible to a range of issues t...
research
∙
09/03/2019
LCA: Loss Change Allocation for Neural Network Training
Neural networks enjoy widespread use, but many aspects of their training...
research
∙
06/04/2019
Hamiltonian Neural Networks
Even though neural networks enjoy widespread use, they still struggle to...
research
∙
05/03/2019
Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask
The recent "Lottery Ticket Hypothesis" paper by Frankle & Carbin showed ...
research
∙
04/18/2019
Understanding Neural Networks via Feature Visualization: A survey
A neuroscience method to understanding the brain is to find and study th...
research
∙
11/28/2018
Metropolis-Hastings Generative Adversarial Networks
We introduce the Metropolis-Hastings generative adversarial network (MH-...
research
∙
07/09/2018
An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution
Few ideas have enjoyed as large an impact on deep learning as convolutio...
research
∙
04/24/2018
Measuring the Intrinsic Dimension of Objective Landscapes
Many recently trained neural networks employ large numbers of parameters...
research
∙
11/27/2017
Proceedings of NIPS 2017 Symposium on Interpretable Machine Learning
This is the Proceedings of NIPS 2017 Symposium on Interpretable Machine ...
research
∙
06/19/2017
SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability
We propose a new technique, Singular Vector Canonical Correlation Analys...
research
∙
11/30/2016
Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space
Generating high-resolution, photo-realistic images has been a long-stand...
research
∙
05/30/2016
Synthesizing the preferred inputs for neurons in neural networks via deep generator networks
Deep neural networks (DNNs) have demonstrated state-of-the-art results o...
research
∙
02/11/2016
Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks
We can better understand deep neural networks by identifying which featu...
research
∙
11/24/2015
Convergent Learning: Do different neural networks learn the same representations?
Recent success in training deep neural networks have prompted active inv...
research
∙
11/23/2015
Recombinator Networks: Learning Coarse-to-Fine Feature Aggregation
Deep neural networks with alternating convolutional, max-pooling and dec...
research
∙
06/22/2015
Understanding Neural Networks Through Deep Visualization
Recent years have produced great advances in training large, deep neural...
research
∙
03/18/2015
GSNs : Generative Stochastic Networks
We introduce a novel training principle for probabilistic models that is...
research
∙
12/05/2014
Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images
Deep neural networks (DNNs) have recently been achieving state-of-the-ar...
research
∙
11/06/2014
How transferable are features in deep neural networks?
Many deep neural networks trained on natural images exhibit a curious ph...
research
∙
04/17/2013
Hands-free Evolution of 3D-printable Objects via Eye Tracking
Interactive evolution has shown the potential to create amazing and comp...
research
∙
02/20/2012