Vivek S. Borkar | DeepAI

DeepAI AI Chat

Featured Co-authors

Shalabh Bhatnagar
50 publications
Konstantin Avrachenkov
26 publications
Nikhil Karamchandani
26 publications
Sharayu Moharir
18 publications
Gaurav S. Kasbekar
15 publications
Sarath Pattathil
12 publications
Siddharth Chandak
6 publications
Vaibhav Kumar Gupta
3 publications
Siva Athreya
3 publications
Soumyajit Guin
2 publications
Vikranth R. Dwaracherla
2 publications

∙ 09/01/2023

Controlled Martingale Problems And Their Markov Mimics

In this article we prove under suitable assumptions that the marginals o...

0 Siva Athreya, et al. ∙

∙ 11/03/2022

Reinforcement Learning in Non-Markovian Environments

Following the novel paradigm developed by Van Roy and coauthors for rein...

0 Siddharth Chandak, et al. ∙

∙ 10/10/2022

Actor-Critic or Critic-Actor? A Tale of Two Time Scales

We revisit the standard formulation of tabular actor-critic algorithm as...

0 Shalabh Bhatnagar, et al. ∙

∙ 05/17/2022

Scheduling in Wireless Networks using Whittle Index Theory

We consider the problem of scheduling packet transmissions in a wireless...

0 Karthik GVB, et al. ∙

∙ 11/04/2021

A Concentration Bound for LSPE(λ)

The popular LSPE(λ) algorithm for policy evaluation is revisited to deri...

4 Vivek S. Borkar, et al. ∙

∙ 06/27/2021

Concentration of Contractive Stochastic Approximation and Reinforcement Learning

Using a martingale concentration inequality, concentration bounds `from ...

0 Siddharth Chandak, et al. ∙

∙ 07/08/2020

Dynamic social learning under graph constraints

We argue that graph-constrained dynamic choice with reinforcement can be...

0 Konstantin Avrachenkov, et al. ∙

∙ 04/29/2020

Whittle index based Q-learning for restless bandits with average reward

A novel reinforcement learning algorithm is introduced for multiarmed re...

18 Konstantin Avrachenkov, et al. ∙

∙ 10/10/2019

Scheduling in Wireless Networks with Spatial Reuse of Spectrum as Restless Bandits

We study the problem of scheduling packet transmissions with the aim of ...

0 Vivek S. Borkar, et al. ∙

∙ 01/07/2018

Metastability in Stochastic Replicator Dynamics

We consider a novel model of stochastic replicator dynamics for potentia...

0 Konstantin Avrachenkov, et al. ∙

∙ 10/28/2017

Distributed Server Allocation for Content Delivery Networks

We propose a dynamic formulation of file-sharing networks in terms of an...

0 Sarath Pattathil, et al. ∙

∙ 05/09/2016

Randomized Kaczmarz for Rank Aggregation from Pairwise Comparisons

We revisit the problem of inferring the overall ranking among entities i...

0 Vivek S. Borkar, et al. ∙

∙ 11/27/2015

Gradient Estimation with Simultaneous Perturbation and Compressive Sensing

This paper aims at achieving a "good" estimator for the gradient of a fu...

0 Vivek S. Borkar, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world