Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Mark Rowland

Revisiting Peng's Q($λ$) for Modern Reinforcement Learning

Feb 27, 2021
Tadashi Kozuno, Yunhao Tang, Mark Rowland, RĂ©mi Munos, Steven Kapturowski, Will Dabney, Michal Valko, David Abel

* 26 pages, 7 figures, 2 tables 

  Access Paper or Ask Questions

On The Effect of Auxiliary Tasks on Representation Dynamics

Feb 25, 2021
Clare Lyle, Mark Rowland, Georg Ostrovski, Will Dabney

* AISTATS 2021 

  Access Paper or Ask Questions

Game Plan: What AI can do for Football, and What Football can do for AI

Nov 18, 2020
Karl Tuyls, Shayegan Omidshafiei, Paul Muller, Zhe Wang, Jerome Connor, Daniel Hennes, Ian Graham, William Spearman, Tim Waskett, Dafydd Steele, Pauline Luc, Adria Recasens, Alexandre Galashov, Gregory Thornton, Romuald Elie, Pablo Sprechmann, Pol Moreno, Kris Cao, Marta Garnelo, Praneet Dutta, Michal Valko, Nicolas Heess, Alex Bridgland, Julien Perolat, Bart De Vylder, Ali Eslami, Mark Rowland, Andrew Jaegle, Remi Munos, Trevor Back, Razia Ahamed, Simon Bouton, Nathalie Beauguerlange, Jackson Broshear, Thore Graepel, Demis Hassabis

  Access Paper or Ask Questions

Revisiting Fundamentals of Experience Replay

Jul 13, 2020
William Fedus, Prajit Ramachandran, Rishabh Agarwal, Yoshua Bengio, Hugo Larochelle, Mark Rowland, Will Dabney

* Published at ICML 2020. First two authors contributed equally and code available at 

  Access Paper or Ask Questions

The Value-Improvement Path: Towards Better Representations for Reinforcement Learning

Jun 03, 2020
Will Dabney, André Barreto, Mark Rowland, Robert Dadashi, John Quan, Marc G. Bellemare, David Silver

  Access Paper or Ask Questions

Navigating the Landscape of Games

May 04, 2020
Shayegan Omidshafiei, Karl Tuyls, Wojciech M. Czarnecki, Francisco C. Santos, Mark Rowland, Jerome Connor, Daniel Hennes, Paul Muller, Julien Perolat, Bart De Vylder, Audrunas Gruslys, Remi Munos

  Access Paper or Ask Questions

From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization

Feb 19, 2020
Julien Perolat, Remi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei, Mark Rowland, Pedro Ortega, Neil Burch, Thomas Anthony, David Balduzzi, Bart De Vylder, Georgios Piliouras, Marc Lanctot, Karl Tuyls

* 43 pages 

  Access Paper or Ask Questions

Multiagent Evaluation under Incomplete Information

Oct 30, 2019
Mark Rowland, Shayegan Omidshafiei, Karl Tuyls, Julien Perolat, Michal Valko, Georgios Piliouras, Remi Munos

  Access Paper or Ask Questions

Conditional Importance Sampling for Off-Policy Learning

Oct 16, 2019
Mark Rowland, Anna Harutyunyan, Hado van Hasselt, Diana Borsa, Tom Schaul, RĂ©mi Munos, Will Dabney

  Access Paper or Ask Questions

Adaptive Trade-Offs in Off-Policy Learning

Oct 16, 2019
Mark Rowland, Will Dabney, RĂ©mi Munos

  Access Paper or Ask Questions

A Generalized Training Approach for Multiagent Learning

Sep 27, 2019
Paul Muller, Shayegan Omidshafiei, Mark Rowland, Karl Tuyls, Julien Perolat, Siqi Liu, Daniel Hennes, Luke Marris, Marc Lanctot, Edward Hughes, Zhe Wang, Guy Lever, Nicolas Heess, Thore Graepel, Remi Munos

  Access Paper or Ask Questions

Meta-learning of Sequential Strategies

May 08, 2019
Pedro A. Ortega, Jane X. Wang, Mark Rowland, Tim Genewein, Zeb Kurth-Nelson, Razvan Pascanu, Nicolas Heess, Joel Veness, Alex Pritzel, Pablo Sprechmann, Siddhant M. Jayakumar, Tom McGrath, Kevin Miller, Mohammad Azar, Ian Osband, Neil Rabinowitz, András György, Silvia Chiappa, Simon Osindero, Yee Whye Teh, Hado van Hasselt, Nando de Freitas, Matthew Botvinick, Shane Legg

* DeepMind Technical Report (15 pages, 6 figures) 

  Access Paper or Ask Questions

Orthogonal Estimation of Wasserstein Distances

Apr 05, 2019
Mark Rowland, Jiri Hron, Yunhao Tang, Krzysztof Choromanski, Tamas Sarlos, Adrian Weller

* Published at AISTATS 2019 

  Access Paper or Ask Questions

Statistics and Samples in Distributional Reinforcement Learning

Feb 21, 2019
Mark Rowland, Robert Dadashi, Saurabh Kumar, RĂ©mi Munos, Marc G. Bellemare, Will Dabney

  Access Paper or Ask Questions

The Unreasonable Effectiveness of Structured Random Orthogonal Embeddings

Sep 03, 2018
Krzysztof Choromanski, Mark Rowland, Adrian Weller

  Access Paper or Ask Questions

Gaussian Process Behaviour in Wide Deep Neural Networks

Aug 16, 2018
Alexander G. de G. Matthews, Mark Rowland, Jiri Hron, Richard E. Turner, Zoubin Ghahramani

* This work substantially extends the work of Matthews et al. (2018) published at the International Conference on Learning Representations (ICLR) 2018 

  Access Paper or Ask Questions

Antithetic and Monte Carlo kernel estimators for partial rankings

Jul 25, 2018
Maria Lomeli, Mark Rowland, Arthur Gretton, Zoubin Ghahramani

  Access Paper or Ask Questions

Structured Evolution with Compact Architectures for Scalable Policy Optimization

Jun 12, 2018
Krzysztof Choromanski, Mark Rowland, Vikas Sindhwani, Richard E. Turner, Adrian Weller

  Access Paper or Ask Questions

An Analysis of Categorical Distributional Reinforcement Learning

Feb 22, 2018
Mark Rowland, Marc G. Bellemare, Will Dabney, RĂ©mi Munos, Yee Whye Teh

  Access Paper or Ask Questions

Distributional Reinforcement Learning with Quantile Regression

Oct 27, 2017
Will Dabney, Mark Rowland, Marc G. Bellemare, RĂ©mi Munos

  Access Paper or Ask Questions

Magnetic Hamiltonian Monte Carlo

Aug 19, 2017
Nilesh Tripuraneni, Mark Rowland, Zoubin Ghahramani, Richard Turner

* 34th International Conference on Machine Learning (ICML 2017) 

  Access Paper or Ask Questions

Black-box $α$-divergence Minimization

Jun 01, 2016
José Miguel Hernández-Lobato, Yingzhen Li, Mark Rowland, Daniel Hernández-Lobato, Thang Bui, Richard E. Turner

* Accepted at ICML 2016. The first version (v1) was presented at NIPS workshops on Advances in Approximate Bayesian Inference and Black Box Learning and Inference 

  Access Paper or Ask Questions