Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Improved Worst-Case Regret Bounds for Randomized Least-Squares Value Iteration

Oct 23, 2020
Priyank Agrawal, Jinglin Chen, Nan Jiang


Share this with someone who'll enjoy it:


This paper studies regret minimization with randomized value functions in reinforcement learning. In tabular finite-horizon Markov Decision Processes, we introduce a clipping variant of one classical Thompson Sampling (TS)-like algorithm, randomized least-squares value iteration (RLSVI). We analyze the algorithm using a novel intertwined regret decomposition. Our $\tilde{\mathrm{O}}(H^2S\sqrt{AT})$ high-probability worst-case regret bound improves the previous sharpest worst-case regret bounds for RLSVI and matches the existing state-of-the-art worst-case TS-based regret bounds.

* 36 pages 


   Access Paper Source



Share this with someone who'll enjoy it: