Jason Yosinski

research

∙ 09/16/2021

Language Models are Few-shot Multilingual Learners

General-purpose language models have demonstrated impressive capabilitie...

Genta Indra Winata, et al. ∙

research

∙ 07/16/2021

When does loss-based prioritization fail?

Not all examples are created equal, but standard deep neural network tra...

Niel Teng Hu, et al. ∙

research

∙ 06/26/2020

Supermasks in Superposition

We present the Supermasks in Superposition (SupSup) model, capable of se...

Mitchell Wortsman, et al. ∙

research

∙ 02/21/2020

Estimating Q(s,s') with Deep Deterministic Dynamics Gradients

In this paper, we introduce a novel form of value function, Q(s, s'), th...

Ashley D. Edwards, et al. ∙

research

∙ 12/04/2019

Plug and Play Language Models: a Simple Approach to Controlled Text Generation

Large transformer-based language models (LMs) trained on huge text corpo...

Sumanth Dathathri, et al. ∙

research

∙ 10/18/2019

First-Order Preconditioning via Hypergradient Descent

Standard gradient descent methods are susceptible to a range of issues t...

Ted Moskovitz, et al. ∙

research

∙ 09/03/2019

LCA: Loss Change Allocation for Neural Network Training

Neural networks enjoy widespread use, but many aspects of their training...

Janice Lan, et al. ∙

research

∙ 06/04/2019

Hamiltonian Neural Networks

Even though neural networks enjoy widespread use, they still struggle to...

Sam Greydanus, et al. ∙

research

∙ 05/03/2019

Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask

The recent "Lottery Ticket Hypothesis" paper by Frankle & Carbin showed ...

Hattie Zhou, et al. ∙

research

∙ 04/18/2019

Understanding Neural Networks via Feature Visualization: A survey

A neuroscience method to understanding the brain is to find and study th...

Anh Nguyen, et al. ∙

research

∙ 11/28/2018

Metropolis-Hastings Generative Adversarial Networks

We introduce the Metropolis-Hastings generative adversarial network (MH-...

Ryan Turner, et al. ∙

research

∙ 07/09/2018

An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution

Few ideas have enjoyed as large an impact on deep learning as convolutio...

Rosanne Liu, et al. ∙

research

∙ 04/24/2018

Measuring the Intrinsic Dimension of Objective Landscapes

Many recently trained neural networks employ large numbers of parameters...

Chunyuan Li, et al. ∙

research

∙ 11/27/2017

Proceedings of NIPS 2017 Symposium on Interpretable Machine Learning

This is the Proceedings of NIPS 2017 Symposium on Interpretable Machine ...

Andrew Gordon Wilson, et al. ∙

research

∙ 06/19/2017

SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability

We propose a new technique, Singular Vector Canonical Correlation Analys...

Maithra Raghu, et al. ∙

research

∙ 11/30/2016

Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space

Generating high-resolution, photo-realistic images has been a long-stand...

Anh Nguyen, et al. ∙

research

∙ 05/30/2016

Synthesizing the preferred inputs for neurons in neural networks via deep generator networks

Deep neural networks (DNNs) have demonstrated state-of-the-art results o...

Anh Nguyen, et al. ∙

research

∙ 02/11/2016

Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks

We can better understand deep neural networks by identifying which featu...

Anh Nguyen, et al. ∙

research

∙ 11/24/2015

Convergent Learning: Do different neural networks learn the same representations?

Recent success in training deep neural networks have prompted active inv...

Yixuan Li, et al. ∙

research

∙ 11/23/2015

Recombinator Networks: Learning Coarse-to-Fine Feature Aggregation

Deep neural networks with alternating convolutional, max-pooling and dec...

Sina Honari, et al. ∙

research

∙ 06/22/2015

Understanding Neural Networks Through Deep Visualization

Recent years have produced great advances in training large, deep neural...

Jason Yosinski, et al. ∙

research

∙ 03/18/2015

GSNs : Generative Stochastic Networks

We introduce a novel training principle for probabilistic models that is...

Guillaume Alain, et al. ∙

research

∙ 12/05/2014

Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images

Deep neural networks (DNNs) have recently been achieving state-of-the-ar...

Anh Nguyen, et al. ∙

research

∙ 11/06/2014

How transferable are features in deep neural networks?

Many deep neural networks trained on natural images exhibit a curious ph...

Jason Yosinski, et al. ∙

research

∙ 04/17/2013

Hands-free Evolution of 3D-printable Objects via Eye Tracking

Interactive evolution has shown the potential to create amazing and comp...

Nick Cheney, et al. ∙

research

∙ 02/20/2012

MAV Stabilization using Machine Learning and Onboard Sensors

In many situations, Miniature Aerial Vehicles (MAVs) are limited to usin...

Jason Yosinski, et al. ∙

Jason Yosinski

Featured Co-authors

Yoshua Bengio

Rui Wang

Pascale Fung

Thomas Brox

Ali Farhadi

Andrew Gordon Wilson

Chunyuan Li

Anh Nguyen

Jascha Sohl-Dickstein

Andrea Madotto

Christopher Pal

Language Models are Few-shot Multilingual Learners

When does loss-based prioritization fail?

Supermasks in Superposition

Estimating Q(s,s') with Deep Deterministic Dynamics Gradients

Plug and Play Language Models: a Simple Approach to Controlled Text Generation

First-Order Preconditioning via Hypergradient Descent

LCA: Loss Change Allocation for Neural Network Training

Hamiltonian Neural Networks

Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask

Understanding Neural Networks via Feature Visualization: A survey

Metropolis-Hastings Generative Adversarial Networks

An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution

Measuring the Intrinsic Dimension of Objective Landscapes

Proceedings of NIPS 2017 Symposium on Interpretable Machine Learning

SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability

Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space

Synthesizing the preferred inputs for neurons in neural networks via deep generator networks

Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks

Convergent Learning: Do different neural networks learn the same representations?

Recombinator Networks: Learning Coarse-to-Fine Feature Aggregation

Understanding Neural Networks Through Deep Visualization

GSNs : Generative Stochastic Networks

Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images

How transferable are features in deep neural networks?

Hands-free Evolution of 3D-printable Objects via Eye Tracking

MAV Stabilization using Machine Learning and Onboard Sensors