
Inductive Bias of MultiChannel Linear Convolutional Networks with Bounded Weight Norm
We study the function space characterization of the inductive bias resul...
read it

NeurIPS 2020 Competition: Predicting Generalization in Deep Learning
Understanding generalization in deep learning is arguably one of the mos...
read it

Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy
We provide a detailed asymptotic study of gradient flow trajectories and...
read it

Mirrorless Mirror Descent: A More Natural Discretization of Riemannian Gradient Flow
We present a direct (primal only) derivation of Mirror Descent as a "par...
read it

Kernel and Rich Regimes in Overparametrized Models
A recent line of work studies overparametrized neural networks in the "k...
read it

Implicit Regularization of Normalization Methods
Normalization methods such as batch normalization are commonly used in o...
read it

Kernel and Deep Regimes in Overparametrized Models
A recent line of work studies overparametrized neural networks in the "k...
read it

Lexicographic and DepthSensitive Margins in Homogeneous and NonHomogeneous Deep Models
With an eye toward understanding complexity control in deep learning, we...
read it

On preserving nondiscrimination when combining expert advice
We study the interplay between sequential decision making and avoiding d...
read it

Implicit Bias of Gradient Descent on Linear Convolutional Networks
We show that gradient descent on fullwidth linear convolutional network...
read it

Convergence of Gradient Descent on Separable Data
The implicit bias of gradient descent is not fully understood even in si...
read it

Characterizing Implicit Bias in Terms of Optimization Geometry
We study the bias of generic optimization methods, including Mirror Desc...
read it

Implicit Regularization in Matrix Factorization
We study implicit regularization when optimizing an underdetermined quad...
read it

Preference Completion from Partial Rankings
We propose a novel and efficient algorithm for the collaborative prefere...
read it

Identifiable Phenotyping using Constrained NonNegative Matrix Factorization
This work proposes a new algorithm for automated and simultaneous phenot...
read it

Unified View of Matrix Completion under General Structural Constraints
In this paper, we present a unified analysis of matrix completion under ...
read it

Exponential Family Matrix Completion under Structural Constraints
We consider the matrix completion problem of recovering a structured mat...
read it

Consistent Collective Matrix Completion under Joint Low Rank Structure
We address the collective matrix completion problem of jointly recoverin...
read it
Suriya Gunasekar
is this you? claim profile