
Deep learning: a statistical viewpoint
The remarkable practical success of deep learning has revealed some majo...
read it

On the Minimal Error of Empirical Risk Minimization
We study the minimal error of the Empirical Risk Minimization (ERM) proc...
read it

Topk eXtreme Contextual Bandits with Arm Hierarchy
Motivated by modern applications, such as online advertisement and recom...
read it

Learning the Linear Quadratic Regulator from Nonlinear Observations
We introduce a new problem setting for continuous control called the LQR...
read it

InstanceDependent Complexity of Contextual Bandits and Reinforcement Learning: A DisagreementBased Perspective
In the classical multiarmed bandit problem, instancedependent algorith...
read it

Fast Mixing of MultiScale Langevin Dynamics under the Manifold Hypothesis
Recently, the task of image generation has attracted much attention. In ...
read it

Fast Mixing of MultiScale Langevin Dynamics underthe Manifold Hypothesis
Recently, the task of image generation has attracted much attention. In ...
read it

On Suboptimality of Least Squares with Application to Estimation of Convex Bodies
We develop a technique for establishing lower bounds on the sample compl...
read it

Learning nonlinear dynamical systems from a single trajectory
We introduce algorithms for learning nonlinear dynamical systems of the ...
read it

Beyond UCB: Optimal and Efficient Contextual Bandits with Regression Oracles
A fundamental challenge in contextual bandits is to develop flexible, ge...
read it

Generative Modeling with Denoising AutoEncoders and Langevin Sampling
We study convergence of a generative modeling method that first estimate...
read it

ℓ_∞ Vector Contraction for Rademacher Complexity
We show that the Rademacher complexity of any R^Kvalued function class ...
read it

On the Risk of MinimumNorm Interpolants and Restricted Lower Isometry of Kernels
We study the risk of minimumnorm interpolants of data in a Reproducing ...
read it

Breast Tumor Cellularity Assessment using Deep Neural Networks
Breast cancer is one of the main causes of death worldwide. Histopatholo...
read it

Consistency of Interpolation with Laplace Kernels is a HighDimensional Phenomenon
We show that minimumnorm interpolation in the Reproducing Kernel Hilber...
read it

Just Interpolate: Kernel "Ridgeless" Regression Can Generalize
In the absence of explicit regularization, Kernel "Ridgeless" Regression...
read it

Does data interpolation contradict statistical optimality?
We show that learning methods interpolating the training data can achiev...
read it

Angiodysplasia Detection and Localization Using Deep Convolutional Neural Networks
Accurate detection and localization for angiodysplasia lesions is an imp...
read it

Online Learning: Sufficient Statistics and the Burkholder Method
We uncover a fairly general principle in online learning: If regret can ...
read it

Automatic Instrument Segmentation in RobotAssisted Surgery Using Deep Learning
Semantic segmentation of robotic instruments is an important problem for...
read it

Deep Convolutional Neural Networks for Breast Cancer Histology Image Analysis
Breast cancer is one of the main causes of cancer death worldwide. Early...
read it

Theory of Deep Learning IIb: Optimization Properties of SGD
In Theory IIb we characterize with a mix of theory and experiments the o...
read it

SizeIndependent Sample Complexity of Neural Networks
We study the sample complexity of learning neural networks, by providing...
read it

Pediatric Bone Age Assessment Using Deep Convolutional Neural Networks
Skeletal bone age assessment is a common clinical practice to diagnose e...
read it

FisherRao Metric, Geometry, and Complexity of Neural Networks
We study the relationship between geometry and capacity measures for dee...
read it

Weighted Message Passing and Minimum Energy Flow for Heterogeneous Stochastic Block Models with Side Information
We study the misclassification error for community detection in general ...
read it

ZigZag: A new approach to adaptive online learning
We develop a novel family of algorithms for the online learning setting ...
read it

Nonconvex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysis
Stochastic Gradient Langevin Dynamics (SGLD) is a popular variant of Sto...
read it

A Tutorial on Online Supervised Learning with Applications to Node Classification in Social Networks
We revisit the elegant observation of T. Cover '65 which, perhaps, is no...
read it

Inference via Message Passing on Partially Labeled Stochastic Block Models
We study the community detection and recovery problem in partiallylabel...
read it

BISTRO: An Efficient RelaxationBased Method for Contextual Bandits
We present efficient algorithms for the problem of contextual bandits wi...
read it

On Equivalence of Martingale Tail Bounds and Deterministic Regret Inequalities
We study an equivalence of (i) deterministic pathwise statements appeari...
read it

Adaptive Online Learning
We propose a general framework for studying adaptive regret bounds in th...
read it

Hierarchies of Relaxations for Online Prediction Problems with Evolving Constraints
We study online prediction where regret of the algorithm is measured aga...
read it

Learning with Square Loss: Localization through Offset Rademacher Complexity
We consider regression with square loss and general classes of functions...
read it

Computational and Statistical Boundaries for Submatrix Localization in a Large Noisy Matrix
The interplay between computational efficiency and statistical accuracy ...
read it

Sequential Probability Assignment with Binary Alphabets and Large Classes of Experts
We analyze the problem of sequential probability assignment for binary o...
read it

Online Nonparametric Regression with General Loss Functions
This paper establishes minimax rates for online regression with arbitrar...
read it

Online Optimization : Competing with Dynamic Comparators
Recent literature on online learning has focused on developing adaptive ...
read it

Distributed Detection : Finitetime Analysis and Impact of Network Topology
This paper addresses the problem of distributed detection in multiagent...
read it

Geometric Inference for General HighDimensional Linear Inverse Problems
This paper presents a unified geometric framework for the statistical an...
read it

On ZerothOrder Stochastic Convex Optimization via Random Walks
We propose a method for zeroth order stochastic convex optimization that...
read it

Online Nonparametric Regression
We establish optimal rates for online regression for arbitrary classes o...
read it

Online Learning of Dynamic Parameters in Social Networks
This paper addresses the problem of online learning in a dynamic setting...
read it

Efficient Sampling from TimeVarying LogConcave Distributions
We propose a computationally efficient random walk on a convex body whic...
read it

Competing With Strategies
We study the problem of online learning with a notion of regret defined ...
read it

Online Learning with Predictable Sequences
We present methods for online linear optimization that take advantage of...
read it

Relax and Localize: From Value to Algorithms
We show a principled way of deriving online learning algorithms from a m...
read it

Online Learning: Stochastic and Constrained Adversaries
Learning theory has largely focused on two main learning scenarios. The ...
read it

Online Learning: Beyond Regret
We study online learnability of a wide class of problems, extending the ...
read it