research
∙
03/15/2022
Surrogate Gap Minimization Improves Sharpness-Aware Training
The recently proposed Sharpness-Aware Minimization (SAM) improves genera...
share
research
∙
10/11/2021
Momentum Centering and Asynchronous Update for Adaptive Gradient Methods
We propose ACProp (Asynchronous-centering-Prop), an adaptive optimizer w...
research
∙
02/09/2021
MALI: A memory efficient and reverse accurate integrator for Neural ODEs
Neural ordinary differential equations (Neural ODEs) are a new family of...
research
∙
10/15/2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Most popular optimizers for deep learning can be broadly categorized as ...
research
∙
06/03/2020
Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODE
Neural ordinary differential equations (NODEs) have recently attracted i...
research
∙
11/02/2019
Sparse Regression Codes
Developing computationally-efficient codes that approach the Shannon-the...
research
∙
08/27/2018
Zero-shot Transfer Learning for Semantic Parsing
While neural networks have shown impressive performance on large dataset...
research
∙
07/19/2018
Sequence to Logic with Copy and Cache
Generating logical form equivalents of human language is a fresh way to ...
research
∙
06/10/2018
Identifiability in Gaussian Graphical Models
In high-dimensional graph learning problems, some topological properties...
research
∙
11/27/2017
The Time-Invariant Multidimensional Gaussian Sequential Rate-Distortion Problem Revisited
We revisit the sequential rate-distortion (SRD) trade-off problem for ve...
research
∙
02/12/2016
Scale-free network optimization: foundations and algorithms
We investigate the fundamental principles that drive the development of ...
research
∙
12/12/2012
Loopy Belief Propogation and Gibbs Measures
We address the question of convergence in the loopy belief propagation (...
research
∙
12/07/2012
Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding
We propose computationally efficient encoders and decoders for lossy com...
research
∙
12/02/2012
Message-Passing Algorithms for Quadratic Minimization
Gaussian belief propagation (GaBP) is an iterative algorithm for computi...
research
∙
02/03/2012
Lossy Compression via Sparse Linear Regression: Performance under Minimum-distance Encoding
We study a new class of codes for lossy compression with the squared-err...
research
∙
02/17/2010