Jianfeng Lu

Random Coordinate Langevin Monte Carlo

Langevin Monte Carlo (LMC) is a popular Markov chain Monte Carlo samplin...
10/03/2020 ∙ by Zhiyan Ding, et al. ∙ 4 ∙ share

read it
Efficient sampling from the Bingham distribution

We give a algorithm for exact sampling from the Bingham distribution p(x...
09/30/2020 ∙ by Rong Ge, et al. ∙ 0 ∙ share

read it
On explicit L^2-convergence rate estimate for piecewise deterministic Markov processes

We establish L^2-exponential convergence rate for three popular piecewis...
07/29/2020 ∙ by Jianfeng Lu, et al. ∙ 0 ∙ share

read it
Neural Machine Translation with Error Correction

Neural machine translation (NMT) generates the next target token given a...
07/21/2020 ∙ by Kaitao Song, et al. ∙ 0 ∙ share

read it
A Proximal-Gradient Algorithm for Crystal Surface Evolution

As a counterpoint to recent numerical methods for crystal surface evolut...
06/22/2020 ∙ by Katy Craig, et al. ∙ 0 ∙ share

read it
Stable Phase Retrieval from Locally Stable and Conditionally Connected Measurements

This paper is concerned with stable phase retrieval for a family of phas...
06/21/2020 ∙ by Cheng Cheng, et al. ∙ 0 ∙ share

read it
Numerical analysis for inchworm Monte Carlo method: Sign problem and error growth

We consider the numerical analysis of the inchworm Monte Carlo method, w...
06/13/2020 ∙ by Zhenning Cai, et al. ∙ 0 ∙ share

read it
LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning

While pre-training and fine-tuning, e.g., BERT <cit.>, GPT-2 <cit.>, hav...
04/27/2020 ∙ by Kaitao Song, et al. ∙ 0 ∙ share

read it
MPNet: Masked and Permuted Pre-training for Language Understanding

BERT adopts masked language modeling (MLM) for pre-training and is one o...
04/20/2020 ∙ by Kaitao Song, et al. ∙ 0 ∙ share

read it
A Universal Approximation Theorem of Deep Neural Networks for Expressing Distributions

This paper studies the universal approximation property of deep neural n...
04/19/2020 ∙ by Yulong Lu, et al. ∙ 0 ∙ share

read it
Posterior computation with the Gibbs zig-zag sampler

Markov chain Monte Carlo (MCMC) sampling algorithms have dominated the l...
04/08/2020 ∙ by Matthias Sachs, et al. ∙ 0 ∙ share

read it
Complexity of randomized algorithms for underdamped Langevin dynamics

We establish an information complexity lower bound of randomized algorit...
03/22/2020 ∙ by Yu Cao, et al. ∙ 0 ∙ share

read it
Existence and computation of generalized Wannier functions for non-periodic systems in two dimensions and higher

Exponentially-localized Wannier functions (ELWFs) are a basis of the Fer...
03/14/2020 ∙ by Kevin D. Stubbs, et al. ∙ 0 ∙ share

read it
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth

Training deep neural networks with stochastic gradient descent (SGD) can...
03/11/2020 ∙ by Yiping Lu, et al. ∙ 42 ∙ share

read it
Ensemble Kalman Inversion for nonlinear problems: weights, consistency, and variance bounds

Ensemble Kalman Inversion (EnKI), originally derived from Enseble Kalman...
03/04/2020 ∙ by Zhiyan Ding, et al. ∙ 0 ∙ share

read it
Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion Monte Carlo like approach

We propose a new method to solve eigenvalue problems for linear and semi...
02/07/2020 ∙ by Jiequn Han, et al. ∙ 0 ∙ share

read it
Deep Network Approximation for Smooth Functions

This paper establishes optimal approximation error characterization of d...
01/09/2020 ∙ by Jianfeng Lu, et al. ∙ 0 ∙ share

read it
Non-Convex Planar Harmonic Maps

We formulate a novel characterization of a family of invertible maps bet...
01/05/2020 ∙ by Shahar Z. Kovalsky, et al. ∙ 0 ∙ share

read it
Universal approximation of symmetric and anti-symmetric functions

We consider universal approximations of symmetric and anti-symmetric fun...
12/04/2019 ∙ by Jiequn Han, et al. ∙ 0 ∙ share

read it
Part-based Multi-stream Model for Vehicle Searching

Due to the enormous requirement in public security and intelligent trans...
11/11/2019 ∙ by Ya Sun, et al. ∙ 17 ∙ share

read it
Estimating Normalizing Constants for Log-Concave Distributions: Algorithms and Lower Bounds

Estimating the normalizing constant of an unnormalized probability distr...
11/08/2019 ∙ by Rong Ge, et al. ∙ 0 ∙ share

read it
Fisher information regularization schemes for Wasserstein gradient flows

We propose a variational scheme for computing Wasserstein gradient flows...
07/03/2019 ∙ by Wuchen Li, et al. ∙ 1 ∙ share

read it
Efficient posterior sampling for high-dimensional imbalanced logistic regression

High-dimensional data are routinely collected in many application areas....
05/27/2019 ∙ by Deborshee Sen, et al. ∙ 0 ∙ share

read it
Temporal-difference learning for nonlinear value function approximation in the lazy training regime

We discuss the approximation of the value function for infinite-horizon ...
05/27/2019 ∙ by Andrea Agazzi, et al. ∙ 0 ∙ share

read it
Accelerating Langevin Sampling with Birth-death

A fundamental problem in Bayesian inference and statistical machine lear...
05/23/2019 ∙ by Yulong Lu, et al. ∙ 0 ∙ share

read it
Tensor Ring Decomposition: Energy Landscape and One-loop Convergence of Alternating Least Squares

In this work, we study the tensor ring decomposition and its associated ...
05/17/2019 ∙ by Ziang Chen, et al. ∙ 0 ∙ share

read it
Variational training of neural network approximations of solution maps for physical models

A novel solve-training framework is proposed to train neural network in ...
05/07/2019 ∙ by Yingzhou Li, et al. ∙ 0 ∙ share

read it
MASS: Masked Sequence to Sequence Pre-training for Language Generation

Pre-training and fine-tuning, e.g., BERT, have achieved great success in...
05/07/2019 ∙ by Kaitao Song, et al. ∙ 0 ∙ share

read it
Tensorization of the strong data processing inequality for quantum chi-square divergences

Quantifying the contraction of classical and quantum states under noisy ...
04/13/2019 ∙ by Yu Cao, et al. ∙ 0 ∙ share

read it
Generating Adversarial Examples With Conditional Generative Adversarial Net

Recently, deep neural networks have significant progress and successful ...
03/18/2019 ∙ by Ping Yu, et al. ∙ 0 ∙ share

read it
A stochastic version of Stein Variational Gradient Descent for efficient sampling

We propose in this work RBM-SVGD, a stochastic version of Stein Variatio...
02/09/2019 ∙ by Lei Li, et al. ∙ 0 ∙ share

read it
Weakly supervised segment annotation via expectation kernel density estimation

Since the labelling for the positive images/videos is ambiguous in weakl...
12/15/2018 ∙ by Liantao Wang, et al. ∙ 0 ∙ share

read it
Hybrid Self-Attention Network for Machine Translation

The encoder-decoder is the typical framework for Neural Machine Translat...
11/01/2018 ∙ by Kaitao Song, et al. ∙ 0 ∙ share

read it
Simulated Tempering Method in the Infinite Switch Limit with Adaptive Weight Learning

We investigate the theoretical foundations of the simulated tempering me...
09/13/2018 ∙ by Anton Martinsson, et al. ∙ 0 ∙ share

read it
Double Path Networks for Sequence to Sequence Learning

Encoder-decoder based Sequence to Sequence learning (S2S) has made remar...
06/13/2018 ∙ by Kaitao Song, et al. ∙ 0 ∙ share

read it
Stochastic modified equations for the asynchronous stochastic gradient descent

We propose a stochastic modified equations (SME) for modeling the asynch...
05/21/2018 ∙ by Jing An, et al. ∙ 0 ∙ share

read it
Butterfly-Net: Optimal Function Representation Based on Convolutional Neural Networks

Deep networks, especially Convolutional Neural Networks (CNNs), have bee...
05/18/2018 ∙ by Yingzhou Li, et al. ∙ 0 ∙ share

read it
Stop memorizing: A data-dependent regularization framework for intrinsic pattern learning

Deep neural networks (DNNs) typically have enough capacity to fit random...
05/18/2018 ∙ by Wei Zhu, et al. ∙ 0 ∙ share

read it
Scaling limit of the Stein variational gradient descent part I: the mean field regime

We study an interacting particle system in R^d motivated by Stein variat...
05/10/2018 ∙ by Jianfeng Lu, et al. ∙ 0 ∙ share

read it
Solving for high dimensional committor functions using artificial neural networks

In this note we propose a method based on artificial neural network to s...
02/28/2018 ∙ by Yuehaw Khoo, et al. ∙ 0 ∙ share

read it
Game-Theoretic Design of Optimal Two-Sided Rating Protocols for Service Exchange Dilemma in Crowdsourcing

Despite the increasing popularity and successful examples of crowdsourci...
12/28/2017 ∙ by Jianfeng Lu, et al. ∙ 0 ∙ share

read it
Rating Protocol Design for Extortion and Cooperation in the Crowdsourcing Contest Dilemma

Crowdsourcing has emerged as a paradigm for leveraging human intelligenc...
12/28/2017 ∙ by Jianfeng Lu, et al. ∙ 0 ∙ share

read it
Methodological and computational aspects of parallel tempering methods in the infinite swapping limit

A variant of the parallel tempering method is proposed in terms of a sto...
12/19/2017 ∙ by Jianfeng Lu, et al. ∙ 0 ∙ share

read it
Asking the Difficult Questions: Goal-Oriented Visual Question Generation via Intermediate Rewards

Despite significant progress in a variety of vision-and-language problem...
11/21/2017 ∙ by Junjie Zhang, et al. ∙ 0 ∙ share

read it
Kill Two Birds with One Stone: Weakly-Supervised Neural Network for Image Annotation and Tag Refinement

The number of social images has exploded by the wide adoption of social ...
11/19/2017 ∙ by Junjie Zhang, et al. ∙ 0 ∙ share

read it
Multi-Label Image Classification with Regional Latent Semantic Dependencies

Deep convolution neural networks (CNN) have demonstrated advanced perfor...
12/04/2016 ∙ by Junjie Zhang, et al. ∙ 0 ∙ share

read it

Jianfeng Lu

Featured Co-authors