Roman Novak | DeepAI

DeepAI AI Chat

Featured Co-authors

Amin Karbasi
77 publications
Michael Auli
68 publications
Jascha Sohl-Dickstein
68 publications
David Grangier
39 publications
Jeffrey Pennington
28 publications
Jaehoon Lee
26 publications
Samuel S. Schoenholz
26 publications
Alexander A. Alemi
24 publications
Ben Adlam
16 publications
Amir Zandieh
15 publications
Jiri Hron
15 publications

∙ 09/09/2022

Fast Neural Kernel Embeddings for General Activations

Infinite width limit has shed light on generalization and optimization a...

0 Insu Han, et al. ∙

∙ 06/17/2022

Fast Finite Width Neural Tangent Kernel

The Neural Tangent Kernel (NTK), defined as Θ_θ^f(x_1, x_2) = [∂ f(θ, x_...

80 Roman Novak, et al. ∙

∙ 06/15/2022

Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling

We introduce repriorisation, a data-dependent reparameterisation which t...

0 Jiri Hron, et al. ∙

∙ 07/27/2021

Dataset Distillation with Infinitely Wide Convolutional Networks

The effectiveness of machine learning algorithms arises from being able ...

0 Timothy Nguyen, et al. ∙

∙ 07/31/2020

Finite Versus Infinite Neural Networks: an Empirical Study

We perform a careful, thorough, and large scale empirical study of the c...

49 Jaehoon Lee, et al. ∙

∙ 06/18/2020

Exact posterior distributions of wide Bayesian neural networks

Recent work has shown that the prior over functions induced by a deep Ba...

0 Jiri Hron, et al. ∙

∙ 06/18/2020

Infinite attention: NNGP and NTK for deep attention networks

There is a growing amount of literature on the relationship between wide...

0 Jiri Hron, et al. ∙

∙ 01/21/2020

On the infinite width limit of neural networks with a standard parameterization

There are currently two parameterizations used to derive fixed kernels c...

13 Jascha Sohl-Dickstein, et al. ∙

∙ 12/05/2019

Neural Tangents: Fast and Easy Infinite Neural Networks in Python

Neural Tangents is a library designed to enable research into infinite-w...

14 Roman Novak, et al. ∙

∙ 10/11/2018

Bayesian Convolutional Neural Networks with Many Channels are Gaussian Processes

There is a previously identified equivalence between wide fully connecte...

18 Roman Novak, et al. ∙

∙ 02/23/2018

Sensitivity and Generalization in Neural Networks: an Empirical Study

In practice it is often found that large over-parameterized neural netwo...

0 Roman Novak, et al. ∙

∙ 11/01/2017

Deep Neural Networks as Gaussian Processes

A deep fully-connected neural network with an i.i.d. prior over its para...

0 Jaehoon Lee, et al. ∙

∙ 10/20/2016

Iterative Refinement for Machine Translation

Existing machine translation decoding algorithms generate translations i...

0 Roman Novak, et al. ∙

∙ 02/23/2016

Exploring the Neural Algorithm of Artistic Style

We explore the method of style transfer presented in the article "A Neur...

0 Yaroslav Nikulin, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world