Spencer Frei | DeepAI

DeepAI AI Chat

Featured Co-authors

Quanquan Gu
124 publications
Nathan Srebro
96 publications
Yuan Cao
85 publications
Bin Yu
67 publications
Peter L. Bartlett
64 publications
Gal Vardi
25 publications
Difan Zou
22 publications
Niladri S. Chatterji
20 publications
Zixiang Chen
11 publications
Nikhil Ghosh
7 publications
Ruiqi Zhang
6 publications

∙ 08/06/2023

The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning

In this work, we investigate the dynamics of stochastic gradient descent...

0 Nikhil Ghosh, et al. ∙

∙ 06/16/2023

Trained Transformers Learn Linear Models In-Context

Attention-based neural networks such as transformers have demonstrated a...

0 Ruiqi Zhang, et al. ∙

∙ 03/02/2023

Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization

Linear classifiers and leaky ReLU networks trained by gradient flow on t...

0 Spencer Frei, et al. ∙

∙ 03/02/2023

The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks

In this work, we study the implications of the implicit bias of gradient...

0 Spencer Frei, et al. ∙

∙ 02/15/2022

Random Feature Amplification: Feature Learning and Generalization in Neural Networks

In this work, we provide a characterization of the feature-learning proc...

0 Spencer Frei, et al. ∙

∙ 02/11/2022

Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data

Benign overfitting, the phenomenon where interpolating models generalize...

0 Spencer Frei, et al. ∙

∙ 06/25/2021

Self-training Converts Weak Learners to Strong Learners in Mixture Models

We consider a binary classification problem when the data comes from a m...

2 Spencer Frei, et al. ∙

∙ 06/25/2021

Proxy Convexity: A Unified Framework for the Analysis of Neural Networks Trained by Gradient Descent

Although the optimization objectives for learning neural networks are hi...

7 Spencer Frei, et al. ∙

∙ 04/19/2021

Provable Robustness of Adversarial Training for Learning Halfspaces with Noise

We analyze the properties of adversarial training for learning adversari...

8 Difan Zou, et al. ∙

∙ 01/04/2021

Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise

We consider a one-hidden-layer leaky ReLU network of arbitrary width tra...

3 Spencer Frei, et al. ∙

∙ 10/01/2020

Agnostic Learning of Halfspaces with Gradient Descent via Soft Margins

We analyze the properties of gradient descent on convex surrogates for t...

1 Spencer Frei, et al. ∙

∙ 05/29/2020

Agnostic Learning of a Single Neuron with Gradient Descent

We consider the problem of learning the best-fitting single neuron as me...

4 Spencer Frei, et al. ∙

∙ 10/07/2019

Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks

The skip-connections used in residual networks have become a standard ar...

14 Spencer Frei, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world