The authors of Stochastic approximation with cone-contractive operators: Sharp $\ell_\infty$-bounds for $Q$-learning have not publicly listed the code yet.

Request code directly from the authors: Ask Authors for Code

Get an expert to implement this paper: Request Implementation

(OR if you have code to share with the community, please add it here 😊🙏 )