Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Marcus Hutter

On the Role of Neural Collapse in Transfer Learning


Jan 04, 2022
Tomer Galanti, András György, Marcus Hutter


  Access Paper or Ask Questions

Isotuning With Applications To Scale-Free Online Learning


Dec 29, 2021
Laurent Orseau, Marcus Hutter


  Access Paper or Ask Questions

Reducing Planning Complexity of General Reinforcement Learning with Non-Markovian Abstractions


Dec 26, 2021
Sultan J. Majeed, Marcus Hutter


  Access Paper or Ask Questions

Shaking the foundations: delusions in sequence models for interaction and control


Oct 20, 2021
Pedro A. Ortega, Markus Kunesch, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Joel Veness, Jonas Buchli, Jonas Degrave, Bilal Piot, Julien Perolat, Tom Everitt, Corentin Tallec, Emilio Parisotto, Tom Erez, Yutian Chen, Scott Reed, Marcus Hutter, Nando de Freitas, Shane Legg

* DeepMind Tech Report, 16 pages, 4 figures 

  Access Paper or Ask Questions

Reward-Punishment Symmetric Universal Intelligence


Oct 06, 2021
Samuel Allen Alexander, Marcus Hutter

* 11 pages, accepted to AGI-21 

  Access Paper or Ask Questions

Reinforcement Learning with Information-Theoretic Actuation


Sep 30, 2021
Elliot Catt, Marcus Hutter, Joel Veness


  Access Paper or Ask Questions

Intelligence and Unambitiousness Using Algorithmic Information Theory


May 13, 2021
Michael K. Cohen, Badri Vellambi, Marcus Hutter

* Journal of Selected Areas in Information Theory 2 (2021) 
* 13 pages, 6 figures, 5-page appendix. arXiv admin note: text overlap with arXiv:1905.12186 

  Access Paper or Ask Questions

Fully General Online Imitation Learning


Feb 17, 2021
Michael K. Cohen, Marcus Hutter, Neel Nanda

* 13 pages with 8-page appendix 

  Access Paper or Ask Questions

Learning Curve Theory


Feb 08, 2021
Marcus Hutter

* 26 pages, 6 Figures 

  Access Paper or Ask Questions

Exact Reduction of Huge Action Spaces in General Reinforcement Learning


Dec 18, 2020
Sultan Javed Majeed, Marcus Hutter

* A variant of this paper was presented at the AAAI-2021 proceedings 

  Access Paper or Ask Questions

Counterfactual Credit Assignment in Model-Free Reinforcement Learning


Nov 18, 2020
Thomas Mesnard, Théophane Weber, Fabio Viola, Shantanu Thakoor, Alaa Saade, Anna Harutyunyan, Will Dabney, Tom Stepleton, Nicolas Heess, Arthur Guez, Marcus Hutter, Lars Buesing, Rémi Munos


  Access Paper or Ask Questions

A Combinatorial Perspective on Transfer Learning


Oct 23, 2020
Jianan Wang, Eren Sezener, David Budden, Marcus Hutter, Joel Veness


  Access Paper or Ask Questions

On Representing (Anti)Symmetric Functions


Jul 30, 2020
Marcus Hutter

* 22 pages, 1 table 

  Access Paper or Ask Questions

Logarithmic Pruning is All You Need


Jun 22, 2020
Laurent Orseau, Marcus Hutter, Omar Rivasplata


  Access Paper or Ask Questions

Pessimism About Unknown Unknowns Inspires Conservatism


Jun 15, 2020
Michael K. Cohen, Marcus Hutter

* 12 pages, plus 16-page appendix; to be published in COLT 2020 proceedings 

  Access Paper or Ask Questions

Curiosity Killed the Cat and the Asymptotically Optimal Agent


Jun 05, 2020
Michael K. Cohen, Marcus Hutter

* 8 pages, with 4 page appendix; 1 figure 

  Access Paper or Ask Questions

Online Learning in Contextual Bandits using Gated Linear Networks


Feb 21, 2020
Eren Sezener, Marcus Hutter, David Budden, Jianan Wang, Joel Veness


  Access Paper or Ask Questions

Gated Linear Networks


Sep 30, 2019
Joel Veness, Tor Lattimore, Avishkar Bhoopchand, David Budden, Christopher Mattern, Agnieszka Grabska-Barwinska, Peter Toth, Simon Schmitt, Marcus Hutter

* arXiv admin note: substantial text overlap with arXiv:1712.01897 

  Access Paper or Ask Questions

Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective


Aug 20, 2019
Tom Everitt, Marcus Hutter


  Access Paper or Ask Questions

Fairness without Regret


Jul 11, 2019
Marcus Hutter

* 11 pages, 2 figures, 1 table, keywords: utility, objective, optimal, fair/equitable/just, cost/regret, uncertainty 

  Access Paper or Ask Questions

Asymptotically Unambitious Artificial General Intelligence


May 29, 2019
Michael K Cohen, Badri Vellambi, Marcus Hutter

* 13 pages with 4 figures; 14 page Appendix with 2 figures 

  Access Paper or Ask Questions

Conditions on Features for Temporal Difference-Like Methods to Converge


May 28, 2019
Marcus Hutter, Samuel Yang-Zhao, Sultan J. Majeed

* 13 pages, 6 figures 

  Access Paper or Ask Questions

Strong Asymptotic Optimality in General Environments


Mar 04, 2019
Michael K. Cohen, Elliot Catt, Marcus Hutter

* 6 pages, 3 figures 

  Access Paper or Ask Questions

Performance Guarantees for Homomorphisms Beyond Markov Decision Processes


Nov 09, 2018
Sultan Javed Majeed, Marcus Hutter


  Access Paper or Ask Questions

AGI Safety Literature Review


May 21, 2018
Tom Everitt, Gary Lea, Marcus Hutter

* Published in International Joint Conference on Artificial Intelligence (IJCAI), 2018 

  Access Paper or Ask Questions

A Topological Approach to Meta-heuristics: Analytical Results on the BFS vs. DFS Algorithm Selection Problem


Apr 12, 2018
Tom Everitt, Marcus Hutter

* Main results published in 28th Australian Joint Conference on Artificial Intelligence, 2015 

  Access Paper or Ask Questions

Reinforcement Learning with a Corrupted Reward Channel


Aug 19, 2017
Tom Everitt, Victoria Krakovna, Laurent Orseau, Marcus Hutter, Shane Legg

* A shorter version of this report was accepted to IJCAI 2017 AI and Autonomy track 

  Access Paper or Ask Questions

Count-Based Exploration in Feature Space for Reinforcement Learning


Jun 25, 2017
Jarryd Martin, Suraj Narayanan Sasikumar, Tom Everitt, Marcus Hutter

* Conference: Twenty-sixth International Joint Conference on Artificial Intelligence (IJCAI-17), 8 pages, 1 figure 

  Access Paper or Ask Questions

Universal Reinforcement Learning Algorithms: Survey and Experiments


May 30, 2017
John Aslanides, Jan Leike, Marcus Hutter

* 8 pages, 6 figures, Twenty-sixth International Joint Conference on Artificial Intelligence (IJCAI-17) 

  Access Paper or Ask Questions