Alert button

Full Gradient Deep Reinforcement Learning for Average-Reward Criterion

Add code
Bookmark button
Alert button
Apr 07, 2023
Tejas Pagare, Vivek Borkar, Konstantin Avrachenkov

Figure 1 for Full Gradient Deep Reinforcement Learning for Average-Reward Criterion
Figure 2 for Full Gradient Deep Reinforcement Learning for Average-Reward Criterion
Figure 3 for Full Gradient Deep Reinforcement Learning for Average-Reward Criterion

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

We extend the provably convergent Full Gradient DQN algorithm for discounted reward Markov decision processes from Avrachenkov et al. (2021) to average reward problems. We experimentally compare widely used RVI Q-Learning with recently proposed Differential Q-Learning in the neural function approximation setting with Full Gradient DQN and DQN. We also extend this to learn Whittle indices for Markovian restless multi-armed bandits. We observe a better convergence rate of the proposed Full Gradient variant across different tasks.

* 13 pages, 4 figures; Accepted by 5th Annual Learning for Dynamics & Control Conference (L4DC) 2023  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon