Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Marc G. Bellemare

Marc G. Bellemare

On Bonus-Based Exploration Methods in the Arcade Learning Environment


Sep 22, 2021
Adrien Ali Taïga, William Fedus, Marlos C. Machado, Aaron Courville, Marc G. Bellemare

Figure 1 for On Bonus-Based Exploration Methods in the Arcade Learning Environment
Figure 2 for On Bonus-Based Exploration Methods in the Arcade Learning Environment
Figure 3 for On Bonus-Based Exploration Methods in the Arcade Learning Environment
Figure 4 for On Bonus-Based Exploration Methods in the Arcade Learning Environment
* Published as a conference paper at ICLR 2020 
 * Full version of arXiv:1908.02388 
  Access Paper or Ask Questions

Deep Reinforcement Learning at the Edge of the Statistical Precipice


Aug 30, 2021
Rishabh Agarwal, Max Schwarzer, Pablo Samuel Castro, Aaron Courville, Marc G. Bellemare

Figure 1 for Deep Reinforcement Learning at the Edge of the Statistical Precipice
Figure 2 for Deep Reinforcement Learning at the Edge of the Statistical Precipice
Figure 3 for Deep Reinforcement Learning at the Edge of the Statistical Precipice
Figure 4 for Deep Reinforcement Learning at the Edge of the Statistical Precipice

  Access Paper or Ask Questions

Metrics and continuity in reinforcement learning


Feb 02, 2021
Charline Le Lan, Marc G. Bellemare, Pablo Samuel Castro

Figure 1 for Metrics and continuity in reinforcement learning
Figure 2 for Metrics and continuity in reinforcement learning
Figure 3 for Metrics and continuity in reinforcement learning
Figure 4 for Metrics and continuity in reinforcement learning
* Accepted at AAAI 2021 
  Access Paper or Ask Questions

Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning


Jan 13, 2021
Rishabh Agarwal, Marlos C. Machado, Pablo Samuel Castro, Marc G. Bellemare

Figure 1 for Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
Figure 2 for Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
Figure 3 for Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
Figure 4 for Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
* Accepted at ICLR 2021 (Spotlight). Website: https://agarwl.github.io/pse 
  Access Paper or Ask Questions

The Importance of Pessimism in Fixed-Dataset Policy Optimization


Oct 04, 2020
Jacob Buckman, Carles Gelada, Marc G. Bellemare

Figure 1 for The Importance of Pessimism in Fixed-Dataset Policy Optimization
Figure 2 for The Importance of Pessimism in Fixed-Dataset Policy Optimization
Figure 3 for The Importance of Pessimism in Fixed-Dataset Policy Optimization

  Access Paper or Ask Questions

Representations for Stable Off-Policy Reinforcement Learning


Jul 10, 2020
Dibya Ghosh, Marc G. Bellemare

Figure 1 for Representations for Stable Off-Policy Reinforcement Learning
Figure 2 for Representations for Stable Off-Policy Reinforcement Learning
Figure 3 for Representations for Stable Off-Policy Reinforcement Learning
Figure 4 for Representations for Stable Off-Policy Reinforcement Learning
* ICML 2020 
  Access Paper or Ask Questions

The Value-Improvement Path: Towards Better Representations for Reinforcement Learning


Jun 03, 2020
Will Dabney, André Barreto, Mark Rowland, Robert Dadashi, John Quan, Marc G. Bellemare, David Silver

Figure 1 for The Value-Improvement Path: Towards Better Representations for Reinforcement Learning
Figure 2 for The Value-Improvement Path: Towards Better Representations for Reinforcement Learning
Figure 3 for The Value-Improvement Path: Towards Better Representations for Reinforcement Learning
Figure 4 for The Value-Improvement Path: Towards Better Representations for Reinforcement Learning

  Access Paper or Ask Questions

A Distributional Analysis of Sampling-Based Reinforcement Learning Algorithms


Mar 27, 2020
Philip Amortila, Doina Precup, Prakash Panangaden, Marc G. Bellemare

Figure 1 for A Distributional Analysis of Sampling-Based Reinforcement Learning Algorithms
* AISTATS 2020 
  Access Paper or Ask Questions

Zooming for Efficient Model-Free Reinforcement Learning in Metric Spaces


Mar 09, 2020
Ahmed Touati, Adrien Ali Taiga, Marc G. Bellemare

Figure 1 for Zooming for Efficient Model-Free Reinforcement Learning in Metric Spaces
Figure 2 for Zooming for Efficient Model-Free Reinforcement Learning in Metric Spaces

  Access Paper or Ask Questions

On Catastrophic Interference in Atari 2600 Games


Feb 28, 2020
William Fedus, Dibya Ghosh, John D. Martin, Marc G. Bellemare, Yoshua Bengio, Hugo Larochelle

Figure 1 for On Catastrophic Interference in Atari 2600 Games
Figure 2 for On Catastrophic Interference in Atari 2600 Games
Figure 3 for On Catastrophic Interference in Atari 2600 Games
Figure 4 for On Catastrophic Interference in Atari 2600 Games
* First two authors contributed equally. Code available to reproduce experiments at https://github.com/google-research/google-research/tree/master/memento 
  Access Paper or Ask Questions

Algorithmic Improvements for Deep Reinforcement Learning applied to Interactive Fiction


Nov 28, 2019
Vishal Jain, William Fedus, Hugo Larochelle, Doina Precup, Marc G. Bellemare

Figure 1 for Algorithmic Improvements for Deep Reinforcement Learning applied to Interactive Fiction
Figure 2 for Algorithmic Improvements for Deep Reinforcement Learning applied to Interactive Fiction
Figure 3 for Algorithmic Improvements for Deep Reinforcement Learning applied to Interactive Fiction
Figure 4 for Algorithmic Improvements for Deep Reinforcement Learning applied to Interactive Fiction
* To appear in Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20). Accepted for Oral presentation 
  Access Paper or Ask Questions

Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment


Aug 06, 2019
Adrien Ali Taïga, William Fedus, Marlos C. Machado, Aaron Courville, Marc G. Bellemare

Figure 1 for Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment
Figure 2 for Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment
Figure 3 for Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment
Figure 4 for Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment
* Accepted at the second Exploration in Reinforcement Learning Workshop at the 36th International Conference on Machine Learning, Long Beach, California 
  Access Paper or Ask Questions

DeepMDP: Learning Continuous Latent Space Models for Representation Learning


Jun 06, 2019
Carles Gelada, Saurabh Kumar, Jacob Buckman, Ofir Nachum, Marc G. Bellemare

Figure 1 for DeepMDP: Learning Continuous Latent Space Models for Representation Learning
Figure 2 for DeepMDP: Learning Continuous Latent Space Models for Representation Learning
Figure 3 for DeepMDP: Learning Continuous Latent Space Models for Representation Learning
Figure 4 for DeepMDP: Learning Continuous Latent Space Models for Representation Learning
* 13 pages main text, 16 pages appendix. ICML 2019 
  Access Paper or Ask Questions

Hyperbolic Discounting and Learning over Multiple Horizons


Feb 28, 2019
William Fedus, Carles Gelada, Yoshua Bengio, Marc G. Bellemare, Hugo Larochelle

Figure 1 for Hyperbolic Discounting and Learning over Multiple Horizons
Figure 2 for Hyperbolic Discounting and Learning over Multiple Horizons
Figure 3 for Hyperbolic Discounting and Learning over Multiple Horizons
Figure 4 for Hyperbolic Discounting and Learning over Multiple Horizons

  Access Paper or Ask Questions

Statistics and Samples in Distributional Reinforcement Learning


Feb 21, 2019
Mark Rowland, Robert Dadashi, Saurabh Kumar, Rémi Munos, Marc G. Bellemare, Will Dabney

Figure 1 for Statistics and Samples in Distributional Reinforcement Learning
Figure 2 for Statistics and Samples in Distributional Reinforcement Learning
Figure 3 for Statistics and Samples in Distributional Reinforcement Learning
Figure 4 for Statistics and Samples in Distributional Reinforcement Learning

  Access Paper or Ask Questions

A Comparative Analysis of Expected and Distributional Reinforcement Learning


Feb 21, 2019
Clare Lyle, Pablo Samuel Castro, Marc G. Bellemare

Figure 1 for A Comparative Analysis of Expected and Distributional Reinforcement Learning
Figure 2 for A Comparative Analysis of Expected and Distributional Reinforcement Learning
Figure 3 for A Comparative Analysis of Expected and Distributional Reinforcement Learning
Figure 4 for A Comparative Analysis of Expected and Distributional Reinforcement Learning
* To appear in the Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence 
  Access Paper or Ask Questions

The Value Function Polytope in Reinforcement Learning


Feb 15, 2019
Robert Dadashi, Adrien Ali Taïga, Nicolas Le Roux, Dale Schuurmans, Marc G. Bellemare

Figure 1 for The Value Function Polytope in Reinforcement Learning
Figure 2 for The Value Function Polytope in Reinforcement Learning
Figure 3 for The Value Function Polytope in Reinforcement Learning
Figure 4 for The Value Function Polytope in Reinforcement Learning

  Access Paper or Ask Questions

Distributional reinforcement learning with linear function approximation


Feb 08, 2019
Marc G. Bellemare, Nicolas Le Roux, Pablo Samuel Castro, Subhodeep Moitra

Figure 1 for Distributional reinforcement learning with linear function approximation
Figure 2 for Distributional reinforcement learning with linear function approximation
* Proceedings of AISTATS 2019 
 * To appear 
  Access Paper or Ask Questions

The Hanabi Challenge: A New Frontier for AI Research


Feb 01, 2019
Nolan Bard, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, Michael Bowling

Figure 1 for The Hanabi Challenge: A New Frontier for AI Research
Figure 2 for The Hanabi Challenge: A New Frontier for AI Research
Figure 3 for The Hanabi Challenge: A New Frontier for AI Research
Figure 4 for The Hanabi Challenge: A New Frontier for AI Research
* 37 pages, 5 figures, submitted to Artificial Intelligence 
  Access Paper or Ask Questions

A Geometric Perspective on Optimal Representations for Reinforcement Learning


Jan 31, 2019
Marc G. Bellemare, Will Dabney, Robert Dadashi, Adrien Ali Taiga, Pablo Samuel Castro, Nicolas Le Roux, Dale Schuurmans, Tor Lattimore, Clare Lyle

Figure 1 for A Geometric Perspective on Optimal Representations for Reinforcement Learning
Figure 2 for A Geometric Perspective on Optimal Representations for Reinforcement Learning
Figure 3 for A Geometric Perspective on Optimal Representations for Reinforcement Learning
Figure 4 for A Geometric Perspective on Optimal Representations for Reinforcement Learning

  Access Paper or Ask Questions

Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue


Jan 31, 2019
Kory W. Mathewson, Pablo Samuel Castro, Colin Cherry, George Foster, Marc G. Bellemare

Figure 1 for Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue
Figure 2 for Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue
Figure 3 for Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue
Figure 4 for Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue
* 20 pages, 9 figures 
  Access Paper or Ask Questions

Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift


Jan 27, 2019
Carles Gelada, Marc G. Bellemare

Figure 1 for Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift
Figure 2 for Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift
Figure 3 for Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift
Figure 4 for Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift
* AAAI 2019 
  Access Paper or Ask Questions

Dopamine: A Research Framework for Deep Reinforcement Learning


Dec 14, 2018
Pablo Samuel Castro, Subhodeep Moitra, Carles Gelada, Saurabh Kumar, Marc G. Bellemare

Figure 1 for Dopamine: A Research Framework for Deep Reinforcement Learning
Figure 2 for Dopamine: A Research Framework for Deep Reinforcement Learning
Figure 3 for Dopamine: A Research Framework for Deep Reinforcement Learning
Figure 4 for Dopamine: A Research Framework for Deep Reinforcement Learning

  Access Paper or Ask Questions

An Introduction to Deep Reinforcement Learning


Dec 03, 2018
Vincent Francois-Lavet, Peter Henderson, Riashat Islam, Marc G. Bellemare, Joelle Pineau

Figure 1 for An Introduction to Deep Reinforcement Learning
Figure 2 for An Introduction to Deep Reinforcement Learning
Figure 3 for An Introduction to Deep Reinforcement Learning
Figure 4 for An Introduction to Deep Reinforcement Learning
* Foundations and Trends in Machine Learning: Vol. 11, No. 3-4, 2018 
  Access Paper or Ask Questions

Approximate Exploration through State Abstraction


Aug 29, 2018
Adrien Ali Taïga, Aaron Courville, Marc G. Bellemare

Figure 1 for Approximate Exploration through State Abstraction
Figure 2 for Approximate Exploration through State Abstraction
Figure 3 for Approximate Exploration through State Abstraction
Figure 4 for Approximate Exploration through State Abstraction

  Access Paper or Ask Questions

Count-Based Exploration with the Successor Representation


Aug 14, 2018
Marlos C. Machado, Marc G. Bellemare, Michael Bowling

Figure 1 for Count-Based Exploration with the Successor Representation
Figure 2 for Count-Based Exploration with the Successor Representation
Figure 3 for Count-Based Exploration with the Successor Representation
Figure 4 for Count-Based Exploration with the Successor Representation

  Access Paper or Ask Questions