Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Siddhant M. Jayakumar

Top-KAST: Top-K Always Sparse Training


Jun 07, 2021
Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen

* Advances in Neural Information Processing Systems, 33, 20744-20754 

  Access Paper or Ask Questions

Perception-Prediction-Reaction Agents for Deep Reinforcement Learning


Jun 26, 2020
Adam Stooke, Valentin Dalibard, Siddhant M. Jayakumar, Wojciech M. Czarnecki, Max Jaderberg


  Access Paper or Ask Questions

Compressive Transformers for Long-Range Sequence Modelling


Nov 13, 2019
Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, Timothy P. Lillicrap

* 19 pages, 6 figures, 10 tables 

  Access Paper or Ask Questions

Stabilizing Transformers for Reinforcement Learning


Oct 13, 2019
Emilio Parisotto, H. Francis Song, Jack W. Rae, Razvan Pascanu, Caglar Gulcehre, Siddhant M. Jayakumar, Max Jaderberg, Raphael Lopez Kaufman, Aidan Clark, Seb Noury, Matthew M. Botvinick, Nicolas Heess, Raia Hadsell


  Access Paper or Ask Questions

Meta-learning of Sequential Strategies


May 08, 2019
Pedro A. Ortega, Jane X. Wang, Mark Rowland, Tim Genewein, Zeb Kurth-Nelson, Razvan Pascanu, Nicolas Heess, Joel Veness, Alex Pritzel, Pablo Sprechmann, Siddhant M. Jayakumar, Tom McGrath, Kevin Miller, Mohammad Azar, Ian Osband, Neil Rabinowitz, András György, Silvia Chiappa, Simon Osindero, Yee Whye Teh, Hado van Hasselt, Nando de Freitas, Matthew Botvinick, Shane Legg

* DeepMind Technical Report (15 pages, 6 figures) 

  Access Paper or Ask Questions

Information asymmetry in KL-regularized RL


May 03, 2019
Alexandre Galashov, Siddhant M. Jayakumar, Leonard Hasenclever, Dhruva Tirumala, Jonathan Schwarz, Guillaume Desjardins, Wojciech M. Czarnecki, Yee Whye Teh, Razvan Pascanu, Nicolas Heess

* Accepted as a conference paper at ICLR 2019 

  Access Paper or Ask Questions

Distilling Policy Distillation


Feb 06, 2019
Wojciech Marian Czarnecki, Razvan Pascanu, Simon Osindero, Siddhant M. Jayakumar, Grzegorz Swirszcz, Max Jaderberg

* Accepted at AISTATS 2019 

  Access Paper or Ask Questions

Adapting Auxiliary Losses Using Gradient Similarity


Dec 05, 2018
Yunshu Du, Wojciech M. Czarnecki, Siddhant M. Jayakumar, Razvan Pascanu, Balaji Lakshminarayanan


  Access Paper or Ask Questions

Been There, Done That: Meta-Learning with Episodic Recall


Jul 06, 2018
Samuel Ritter, Jane X. Wang, Zeb Kurth-Nelson, Siddhant M. Jayakumar, Charles Blundell, Razvan Pascanu, Matthew Botvinick

* ICML 2018 

  Access Paper or Ask Questions

Mix&Match - Agent Curricula for Reinforcement Learning


Jun 05, 2018
Wojciech Marian Czarnecki, Siddhant M. Jayakumar, Max Jaderberg, Leonard Hasenclever, Yee Whye Teh, Simon Osindero, Nicolas Heess, Razvan Pascanu

* ICML 2018 

  Access Paper or Ask Questions

Low-pass Recurrent Neural Networks - A memory architecture for longer-term correlation discovery


May 13, 2018
Thomas Stepleton, Razvan Pascanu, Will Dabney, Siddhant M. Jayakumar, Hubert Soyer, Remi Munos


  Access Paper or Ask Questions

Memory-based Parameter Adaptation


Feb 28, 2018
Pablo Sprechmann, Siddhant M. Jayakumar, Jack W. Rae, Alexander Pritzel, Adrià Puigdomènech Badia, Benigno Uria, Oriol Vinyals, Demis Hassabis, Razvan Pascanu, Charles Blundell

* Published as a conference paper at ICLR 2018 

  Access Paper or Ask Questions