Zhuoran Yang

is this you? claim profile

∙ 0 followers
Princeton University

Research Internt at Princeton University

Doubly Robust Off-Policy Actor-Critic: Convergence and Optimality

Designing off-policy reinforcement learning algorithms is typically a ve...
02/23/2021 ∙ by Tengyu Xu, et al. ∙ 0 ∙ share

read it
Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning

In offline reinforcement learning (RL) an optimal policy is learnt solel...
02/19/2021 ∙ by Luofeng Liao, et al. ∙ 1 ∙ share

read it
A Momentum-Assisted Single-Timescale Stochastic Approximation Algorithm for Bilevel Optimization

This paper proposes a new algorithm – the Momentum-assisted Single-times...
02/15/2021 ∙ by Prashant Khanduri, et al. ∙ 0 ∙ share

read it
Is Pessimism Provably Efficient for Offline RL?

We study offline reinforcement learning (RL), which aims to learn an opt...
12/30/2020 ∙ by Ying Jin, et al. ∙ 0 ∙ share

read it
Risk-Sensitive Deep RL: Variance-Constrained Actor-Critic Provably Finds Globally Optimal Policy

While deep reinforcement learning has achieved tremendous successes in v...
12/28/2020 ∙ by Han Zhong, et al. ∙ 0 ∙ share

read it
Variational Transport: A Convergent Particle-BasedAlgorithm for Distributional Optimization

We consider the optimization problem of minimizing a functional defined ...
12/21/2020 ∙ by Zhuoran Yang, et al. ∙ 0 ∙ share

read it
On Function Approximation in Reinforcement Learning: Optimism in the Face of Large State Spaces

The classical theory of reinforcement learning (RL) has focused on tabul...
11/09/2020 ∙ by Zhuoran Yang, et al. ∙ 9 ∙ share

read it
Provable Fictitious Play for General Mean-Field Games

We propose a reinforcement learning algorithm for stationary mean-field ...
10/08/2020 ∙ by Qiaomin Xie, et al. ∙ 0 ∙ share

read it
Single-Timescale Stochastic Nonconvex-Concave Optimization for Smooth Nonlinear TD Learning

Temporal-Difference (TD) learning with nonlinear smooth function approxi...
08/23/2020 ∙ by Shuang Qiu, et al. ∙ 0 ∙ share

read it
Global Convergence of Policy Gradient for Linear-Quadratic Mean-Field Control/Game in Continuous Time

Reinforcement learning is a powerful tool to learn the optimal policy of...
08/16/2020 ∙ by Weichen Wang, et al. ∙ 0 ∙ share

read it
Single-Timescale Actor-Critic Provably Finds Globally Optimal Policy

We study the global convergence and global optimality of actor-critic, o...
08/02/2020 ∙ by Zuyue Fu, et al. ∙ 0 ∙ share

read it
Understanding Implicit Regularization in Over-Parameterized Nonlinear Statistical Model

We study the implicit regularization phenomenon induced by simple optimi...
07/16/2020 ∙ by Jianqing Fan, et al. ∙ 0 ∙ share

read it
A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic

This paper analyzes a two-timescale stochastic algorithm for a class of ...
07/10/2020 ∙ by Mingyi Hong, et al. ∙ 0 ∙ share

read it
Provably Efficient Neural Estimation of Structural Equation Model: An Adversarial Approach

Structural equation models (SEMs) are widely used in sciences, ranging f...
07/02/2020 ∙ by Luofeng Liao, et al. ∙ 13 ∙ share

read it
Dynamic Regret of Policy Optimization in Non-stationary Environments

We consider reinforcement learning (RL) in episodic MDPs with adversaria...
06/30/2020 ∙ by Yingjie Fei, et al. ∙ 0 ∙ share

read it
On the Global Optimality of Model-Agnostic Meta-Learning

Model-agnostic meta-learning (MAML) formulates meta-learning as a bileve...
06/23/2020 ∙ by Lingxiao Wang, et al. ∙ 0 ∙ share

read it
Risk-Sensitive Reinforcement Learning: Near-Optimal Risk-Sample Tradeoff in Regret

We study risk-sensitive reinforcement learning in episodic Markov decisi...
06/22/2020 ∙ by Yingjie Fei, et al. ∙ 0 ∙ share

read it
Provably Efficient Causal Reinforcement Learning with Confounded Observational Data

Empowered by expressive function approximators such as neural networks, ...
06/22/2020 ∙ by Lingxiao Wang, et al. ∙ 0 ∙ share

read it
Breaking the Curse of Many Agents: Provable Mean Embedding Q-Iteration for Mean-Field Reinforcement Learning

Multi-agent reinforcement learning (MARL) achieves significant empirical...
06/21/2020 ∙ by Lingxiao Wang, et al. ∙ 0 ∙ share

read it
Neural Certificates for Safe Control Policies

This paper develops an approach to learn a policy of a dynamical system ...
06/15/2020 ∙ by Wanxin Jin, et al. ∙ 0 ∙ share

read it
Can Temporal-Difference and Q-Learning Learn Representation? A Mean-Field Theory

Temporal-difference and Q-learning play a key role in deep reinforcement...
06/08/2020 ∙ by Yufeng Zhang, et al. ∙ 0 ∙ share

read it
An efficient Gehan-type estimation for the accelerated failure time model with clustered and censored data

In medical studies, the collected covariates usually contain underlying ...
03/09/2020 ∙ by Liya Fu, et al. ∙ 0 ∙ share

read it
Generative Adversarial Imitation Learning with Neural Networks: Global Optimality and Convergence Rate

Generative adversarial imitation learning (GAIL) demonstrates tremendous...
03/08/2020 ∙ by Yufeng Zhang, et al. ∙ 0 ∙ share

read it
Semiparametric Nonlinear Bipartite Graph Representation Learning with Provable Guarantees

Graph representation learning is a ubiquitous task in machine learning w...
03/02/2020 ∙ by Sen Na, et al. ∙ 13 ∙ share

read it
Upper Confidence Primal-Dual Optimization: Stochastically Constrained Markov Decision Processes with Adversarial Losses and Unknown Transitions

We consider online learning for episodic Markov decision processes (MDPs...
03/02/2020 ∙ by Shuang Qiu, et al. ∙ 0 ∙ share

read it
Provably Efficient Safe Exploration via Primal-Dual Policy Optimization

We study the Safe Reinforcement Learning (SRL) problem using the Constra...
03/01/2020 ∙ by Dongsheng Ding, et al. ∙ 0 ∙ share

read it
Learning Zero-Sum Simultaneous-Move Markov Games Using Function Approximation and Correlated Equilibrium

We develop provably efficient reinforcement learning algorithms for two-...
02/17/2020 ∙ by Qiaomin Xie, et al. ∙ 0 ∙ share

read it
On Computation and Generalization of Generative Adversarial Imitation Learning

Generative Adversarial Imitation Learning (GAIL) is a powerful and pract...
01/09/2020 ∙ by Minshuo Chen, et al. ∙ 15 ∙ share

read it
Pontryagin Differentiable Programming: An End-to-End Learning and Control Framework

This paper develops a Pontryagin differentiable programming (PDP) method...
12/30/2019 ∙ by Wanxin Jin, et al. ∙ 0 ∙ share

read it
Natural Actor-Critic Converges Globally for Hierarchical Linear Quadratic Regulator

Multi-agent reinforcement learning has been successfully applied to a nu...
12/14/2019 ∙ by Yuwei Luo, et al. ∙ 7 ∙ share

read it
Provably Efficient Exploration in Policy Optimization

While policy-based reinforcement learning (RL) achieves tremendous succe...
12/12/2019 ∙ by Qi Cai, et al. ∙ 0 ∙ share

read it
Decentralized Multi-Agent Reinforcement Learning with Networked Agents: Recent Advances

Multi-agent reinforcement learning (MARL) has long been a significant an...
12/09/2019 ∙ by Kaiqing Zhang, et al. ∙ 0 ∙ share

read it
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms

Recent years have witnessed significant advances in reinforcement learni...
11/24/2019 ∙ by Kaiqing Zhang, et al. ∙ 0 ∙ share

read it
Convergent Policy Optimization for Safe Reinforcement Learning

We study the safe reinforcement learning problem with nonlinear function...
10/26/2019 ∙ by Ming Yu, et al. ∙ 29 ∙ share

read it
Actor-Critic Provably Finds Nash Equilibria of Linear-Quadratic Mean-Field Games

We study discrete-time mean-field Markov games with infinite numbers of ...
10/16/2019 ∙ by Zuyue Fu, et al. ∙ 0 ∙ share

read it
Credible Sample Elicitation by Deep Learning, for Deep Learning

It is important to collect credible training samples (x,y) for building ...
10/08/2019 ∙ by Yang Liu, et al. ∙ 0 ∙ share

read it
Neural Policy Gradient Methods: Global Optimality and Rates of Convergence

Policy gradient methods with actor-critic schemes demonstrate tremendous...
08/29/2019 ∙ by Lingxiao Wang, et al. ∙ 0 ∙ share

read it
Robust One-Bit Recovery via ReLU Generative Networks: Improved Statistical Rates and Global Landscape Analysis

We study the robust one-bit compressed sensing problem whose goal is to ...
08/14/2019 ∙ by Shuang Qiu, et al. ∙ 2 ∙ share

read it
Fast multi-agent temporal-difference learning via homotopy stochastic primal-dual optimization

We consider a distributed multi-agent policy evaluation problem in reinf...
08/07/2019 ∙ by Dongsheng Ding, et al. ∙ 0 ∙ share

read it
More Supervision, Less Computation: Statistical-Computational Tradeoffs in Weakly Supervised Learning

We consider the weakly supervised binary classification problem where th...
07/14/2019 ∙ by Xinyang Yi, et al. ∙ 6 ∙ share

read it
On the Global Convergence of Actor-Critic: A Case for Linear Quadratic Regulator with Ergodic Cost

Despite the empirical success of the actor-critic algorithm, its theoret...
07/14/2019 ∙ by Zhuoran Yang, et al. ∙ 0 ∙ share

read it
Stochastic Convergence Results for Regularized Actor-Critic Methods

In this paper, we present a stochastic convergence proof, under suitable...
07/13/2019 ∙ by Wesley Suttle, et al. ∙ 0 ∙ share

read it
Provably Efficient Reinforcement Learning with Linear Function Approximation

Modern Reinforcement Learning (RL) is commonly applied to practical prob...
07/11/2019 ∙ by Chi Jin, et al. ∙ 3 ∙ share

read it
A Communication-Efficient Multi-Agent Actor-Critic Algorithm for Distributed Reinforcement Learning

This paper considers a distributed reinforcement learning problem in whi...
07/06/2019 ∙ by Yixuan Lin, et al. ∙ 0 ∙ share

read it
Neural Proximal/Trust Region Policy Optimization Attains Globally Optimal Policy

Proximal policy optimization and trust region policy optimization (PPO a...
06/25/2019 ∙ by Boyi Liu, et al. ∙ 0 ∙ share

read it
Policy Optimization Provably Converges to Nash Equilibria in Zero-Sum Linear Quadratic Games

We study the global convergence of policy optimization for finding the N...
05/31/2019 ∙ by Kaiqing Zhang, et al. ∙ 0 ∙ share

read it
Neural Temporal-Difference Learning Converges to Global Optima

Temporal-difference learning (TD), coupled with neural networks, is amon...
05/24/2019 ∙ by Qi Cai, et al. ∙ 0 ∙ share

read it
A Multi-Agent Off-Policy Actor-Critic Algorithm for Distributed Reinforcement Learning

This paper extends off-policy reinforcement learning to the multi-agent ...
03/15/2019 ∙ by Wesley Suttle, et al. ∙ 0 ∙ share

read it
Finite-Sample Analyses for Fully Decentralized Multi-Agent Reinforcement Learning

Despite the increasing interest in multi-agent reinforcement learning (M...
12/06/2018 ∙ by Kaiqing Zhang, et al. ∙ 2 ∙ share

read it
Provable Gaussian Embedding with One Observation

The success of machine learning methods heavily relies on having an appr...
10/25/2018 ∙ by Ming Yu, et al. ∙ 0 ∙ share

read it

Zhuoran Yang

Featured Co-authors