Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Marc Lanctot

Marc Lanctot

Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-Solvers


Jun 22, 2021
Luke Marris, Paul Muller, Marc Lanctot, Karl Tuyls, Thore Graepel

Figure 1 for Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-Solvers
Figure 2 for Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-Solvers
Figure 3 for Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-Solvers
Figure 4 for Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-Solvers
* ICML 2021, 9 pages, coded implementation available in https://github.com/deepmind/open_spiel/ (jpsro.py in examples) 
  Access Paper or Ask Questions

Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games


Feb 13, 2021
Dustin Morrill, Ryan D'Orazio, Marc Lanctot, James R. Wright, Michael Bowling, Amy Greenwald

Figure 1 for Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games
Figure 2 for Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games
Figure 3 for Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games
Figure 4 for Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games
* 32 pages, 6 figures 
  Access Paper or Ask Questions

Solving Common-Payoff Games with Approximate Policy Iteration


Jan 11, 2021
Samuel Sokota, Edward Lockhart, Finbarr Timbers, Elnaz Davoodi, Ryan D'Orazio, Neil Burch, Martin Schmid, Michael Bowling, Marc Lanctot

Figure 1 for Solving Common-Payoff Games with Approximate Policy Iteration
Figure 2 for Solving Common-Payoff Games with Approximate Policy Iteration
Figure 3 for Solving Common-Payoff Games with Approximate Policy Iteration
Figure 4 for Solving Common-Payoff Games with Approximate Policy Iteration
* AAAI 2021 
  Access Paper or Ask Questions

Hindsight and Sequential Rationality of Correlated Play


Dec 17, 2020
Dustin Morrill, Ryan D'Orazio, Reca Sarfati, Marc Lanctot, James R. Wright, Amy Greenwald, Michael Bowling

Figure 1 for Hindsight and Sequential Rationality of Correlated Play
Figure 2 for Hindsight and Sequential Rationality of Correlated Play
Figure 3 for Hindsight and Sequential Rationality of Correlated Play
Figure 4 for Hindsight and Sequential Rationality of Correlated Play
* Technical report for a paper to appear at AAAI 2021. 26 pages, 15 figures 
  Access Paper or Ask Questions

Negotiating Team Formation Using Deep Reinforcement Learning


Oct 20, 2020
Yoram Bachrach, Richard Everett, Edward Hughes, Angeliki Lazaridou, Joel Z. Leibo, Marc Lanctot, Michael Johanson, Wojciech M. Czarnecki, Thore Graepel

Figure 1 for Negotiating Team Formation Using Deep Reinforcement Learning
Figure 2 for Negotiating Team Formation Using Deep Reinforcement Learning
Figure 3 for Negotiating Team Formation Using Deep Reinforcement Learning
Figure 4 for Negotiating Team Formation Using Deep Reinforcement Learning
* Artificial Intelligence 288 (2020): 103356 
  Access Paper or Ask Questions

The Advantage Regret-Matching Actor-Critic


Aug 27, 2020
Audrūnas Gruslys, Marc Lanctot, Rémi Munos, Finbarr Timbers, Martin Schmid, Julien Perolat, Dustin Morrill, Vinicius Zambaldi, Jean-Baptiste Lespiau, John Schultz, Mohammad Gheshlaghi Azar, Michael Bowling, Karl Tuyls

Figure 1 for The Advantage Regret-Matching Actor-Critic
Figure 2 for The Advantage Regret-Matching Actor-Critic
Figure 3 for The Advantage Regret-Matching Actor-Critic
Figure 4 for The Advantage Regret-Matching Actor-Critic

  Access Paper or Ask Questions

Learning to Play No-Press Diplomacy with Best Response Policy Iteration


Jun 17, 2020
Thomas Anthony, Tom Eccles, Andrea Tacchetti, János Kramár, Ian Gemp, Thomas C. Hudson, Nicolas Porcel, Marc Lanctot, Julien Pérolat, Richard Everett, Satinder Singh, Thore Graepel, Yoram Bachrach

Figure 1 for Learning to Play No-Press Diplomacy with Best Response Policy Iteration
Figure 2 for Learning to Play No-Press Diplomacy with Best Response Policy Iteration
Figure 3 for Learning to Play No-Press Diplomacy with Best Response Policy Iteration
Figure 4 for Learning to Play No-Press Diplomacy with Best Response Policy Iteration

  Access Paper or Ask Questions

Approximate exploitability: Learning a best response in large games


Apr 20, 2020
Finbarr Timbers, Edward Lockhart, Martin Schmid, Marc Lanctot, Michael Bowling


  Access Paper or Ask Questions

From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization


Feb 19, 2020
Julien Perolat, Remi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei, Mark Rowland, Pedro Ortega, Neil Burch, Thomas Anthony, David Balduzzi, Bart De Vylder, Georgios Piliouras, Marc Lanctot, Karl Tuyls

Figure 1 for From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization
Figure 2 for From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization
Figure 3 for From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization
Figure 4 for From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization
* 43 pages 
  Access Paper or Ask Questions

OpenSpiel: A Framework for Reinforcement Learning in Games


Oct 10, 2019
Marc Lanctot, Edward Lockhart, Jean-Baptiste Lespiau, Vinicius Zambaldi, Satyaki Upadhyay, Julien Pérolat, Sriram Srinivasan, Finbarr Timbers, Karl Tuyls, Shayegan Omidshafiei, Daniel Hennes, Dustin Morrill, Paul Muller, Timo Ewalds, Ryan Faulkner, János Kramár, Bart De Vylder, Brennan Saeta, James Bradbury, David Ding, Sebastian Borgeaud, Matthew Lai, Julian Schrittwieser, Thomas Anthony, Edward Hughes, Ivo Danihelka, Jonah Ryan-Davis

Figure 1 for OpenSpiel: A Framework for Reinforcement Learning in Games
Figure 2 for OpenSpiel: A Framework for Reinforcement Learning in Games
Figure 3 for OpenSpiel: A Framework for Reinforcement Learning in Games
Figure 4 for OpenSpiel: A Framework for Reinforcement Learning in Games

  Access Paper or Ask Questions

A Generalized Training Approach for Multiagent Learning


Sep 27, 2019
Paul Muller, Shayegan Omidshafiei, Mark Rowland, Karl Tuyls, Julien Perolat, Siqi Liu, Daniel Hennes, Luke Marris, Marc Lanctot, Edward Hughes, Zhe Wang, Guy Lever, Nicolas Heess, Thore Graepel, Remi Munos

Figure 1 for A Generalized Training Approach for Multiagent Learning
Figure 2 for A Generalized Training Approach for Multiagent Learning
Figure 3 for A Generalized Training Approach for Multiagent Learning
Figure 4 for A Generalized Training Approach for Multiagent Learning

  Access Paper or Ask Questions

Neural Replicator Dynamics


Jun 01, 2019
Shayegan Omidshafiei, Daniel Hennes, Dustin Morrill, Remi Munos, Julien Perolat, Marc Lanctot, Audrunas Gruslys, Jean-Baptiste Lespiau, Karl Tuyls

Figure 1 for Neural Replicator Dynamics
Figure 2 for Neural Replicator Dynamics
Figure 3 for Neural Replicator Dynamics
Figure 4 for Neural Replicator Dynamics

  Access Paper or Ask Questions

Computing Approximate Equilibria in Sequential Adversarial Games by Exploitability Descent


Mar 21, 2019
Edward Lockhart, Marc Lanctot, Julien Pérolat, Jean-Baptiste Lespiau, Dustin Morrill, Finbarr Timbers, Karl Tuyls

Figure 1 for Computing Approximate Equilibria in Sequential Adversarial Games by Exploitability Descent
* 11 pages, 1 figure 
  Access Paper or Ask Questions

Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Research


Mar 11, 2019
Joel Z. Leibo, Edward Hughes, Marc Lanctot, Thore Graepel

Figure 1 for Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Research
Figure 2 for Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Research
* 16 pages, 2 figures 
  Access Paper or Ask Questions

The Hanabi Challenge: A New Frontier for AI Research


Feb 01, 2019
Nolan Bard, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, Michael Bowling

Figure 1 for The Hanabi Challenge: A New Frontier for AI Research
Figure 2 for The Hanabi Challenge: A New Frontier for AI Research
Figure 3 for The Hanabi Challenge: A New Frontier for AI Research
Figure 4 for The Hanabi Challenge: A New Frontier for AI Research
* 37 pages, 5 figures, submitted to Artificial Intelligence 
  Access Paper or Ask Questions

Actor-Critic Policy Optimization in Partially Observable Multiagent Environments


Oct 21, 2018
Sriram Srinivasan, Marc Lanctot, Vinicius Zambaldi, Julien Perolat, Karl Tuyls, Remi Munos, Michael Bowling

Figure 1 for Actor-Critic Policy Optimization in Partially Observable Multiagent Environments
Figure 2 for Actor-Critic Policy Optimization in Partially Observable Multiagent Environments
Figure 3 for Actor-Critic Policy Optimization in Partially Observable Multiagent Environments
Figure 4 for Actor-Critic Policy Optimization in Partially Observable Multiagent Environments
* NIPS 2018 
  Access Paper or Ask Questions

Variance Reduction in Monte Carlo Counterfactual Regret Minimization (VR-MCCFR) for Extensive Form Games using Baselines


Sep 09, 2018
Martin Schmid, Neil Burch, Marc Lanctot, Matej Moravcik, Rudolf Kadlec, Michael Bowling

Figure 1 for Variance Reduction in Monte Carlo Counterfactual Regret Minimization (VR-MCCFR) for Extensive Form Games using Baselines
Figure 2 for Variance Reduction in Monte Carlo Counterfactual Regret Minimization (VR-MCCFR) for Extensive Form Games using Baselines
Figure 3 for Variance Reduction in Monte Carlo Counterfactual Regret Minimization (VR-MCCFR) for Extensive Form Games using Baselines
Figure 4 for Variance Reduction in Monte Carlo Counterfactual Regret Minimization (VR-MCCFR) for Extensive Form Games using Baselines

  Access Paper or Ask Questions

Emergent Communication through Negotiation


Apr 11, 2018
Kris Cao, Angeliki Lazaridou, Marc Lanctot, Joel Z Leibo, Karl Tuyls, Stephen Clark

Figure 1 for Emergent Communication through Negotiation
Figure 2 for Emergent Communication through Negotiation
Figure 3 for Emergent Communication through Negotiation
Figure 4 for Emergent Communication through Negotiation
* Published as a conference paper at ICLR 2018 
  Access Paper or Ask Questions

Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm


Dec 05, 2017
David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, Timothy Lillicrap, Karen Simonyan, Demis Hassabis

Figure 1 for Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Figure 2 for Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Figure 3 for Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Figure 4 for Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm

  Access Paper or Ask Questions

Deep Q-learning from Demonstrations


Nov 22, 2017
Todd Hester, Matej Vecerik, Olivier Pietquin, Marc Lanctot, Tom Schaul, Bilal Piot, Dan Horgan, John Quan, Andrew Sendonaris, Gabriel Dulac-Arnold, Ian Osband, John Agapiou, Joel Z. Leibo, Audrunas Gruslys

Figure 1 for Deep Q-learning from Demonstrations
Figure 2 for Deep Q-learning from Demonstrations
Figure 3 for Deep Q-learning from Demonstrations
* Published at AAAI 2018. Previously on arxiv as "Learning from Demonstrations for Real World Reinforcement Learning" 
  Access Paper or Ask Questions

A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning


Nov 07, 2017
Marc Lanctot, Vinicius Zambaldi, Audrunas Gruslys, Angeliki Lazaridou, Karl Tuyls, Julien Perolat, David Silver, Thore Graepel

Figure 1 for A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
Figure 2 for A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
Figure 3 for A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
Figure 4 for A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
* Camera-ready copy of NIPS 2017 paper, including appendix 
  Access Paper or Ask Questions

Value-Decomposition Networks For Cooperative Multi-Agent Learning


Jun 16, 2017
Peter Sunehag, Guy Lever, Audrunas Gruslys, Wojciech Marian Czarnecki, Vinicius Zambaldi, Max Jaderberg, Marc Lanctot, Nicolas Sonnerat, Joel Z. Leibo, Karl Tuyls, Thore Graepel

Figure 1 for Value-Decomposition Networks For Cooperative Multi-Agent Learning
Figure 2 for Value-Decomposition Networks For Cooperative Multi-Agent Learning

  Access Paper or Ask Questions

Memory-Efficient Backpropagation Through Time


Jun 10, 2016
Audrūnas Gruslys, Remi Munos, Ivo Danihelka, Marc Lanctot, Alex Graves

Figure 1 for Memory-Efficient Backpropagation Through Time
Figure 2 for Memory-Efficient Backpropagation Through Time
Figure 3 for Memory-Efficient Backpropagation Through Time
Figure 4 for Memory-Efficient Backpropagation Through Time

  Access Paper or Ask Questions

Convolution by Evolution: Differentiable Pattern Producing Networks


Jun 08, 2016
Chrisantha Fernando, Dylan Banarse, Malcolm Reynolds, Frederic Besse, David Pfau, Max Jaderberg, Marc Lanctot, Daan Wierstra

Figure 1 for Convolution by Evolution: Differentiable Pattern Producing Networks
Figure 2 for Convolution by Evolution: Differentiable Pattern Producing Networks
Figure 3 for Convolution by Evolution: Differentiable Pattern Producing Networks
Figure 4 for Convolution by Evolution: Differentiable Pattern Producing Networks

  Access Paper or Ask Questions

Dueling Network Architectures for Deep Reinforcement Learning


Apr 05, 2016
Ziyu Wang, Tom Schaul, Matteo Hessel, Hado van Hasselt, Marc Lanctot, Nando de Freitas

Figure 1 for Dueling Network Architectures for Deep Reinforcement Learning
Figure 2 for Dueling Network Architectures for Deep Reinforcement Learning
Figure 3 for Dueling Network Architectures for Deep Reinforcement Learning
Figure 4 for Dueling Network Architectures for Deep Reinforcement Learning
* 15 pages, 5 figures, and 5 tables 
  Access Paper or Ask Questions