Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Solving Quantitative Reasoning Problems with Language Models


Jul 01, 2022
Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra

Add code

* 12 pages, 5 figures + references and appendices 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Block-Recurrent Transformers


Mar 11, 2022
DeLesley Hutchins, Imanol Schlag, Yuhuai Wu, Ethan Dyer, Behnam Neyshabur

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

A Modern Self-Referential Weight Matrix That Learns to Modify Itself


Feb 11, 2022
Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Improving Baselines in the Wild


Dec 31, 2021
Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Add code

* Presented at NeurIPS 2021 Workshop on Distribution Shifts, https://openreview.net/forum?id=9vxOrkNTs1x 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Going Beyond Linear Transformers with Recurrent Fast Weight Programmers


Jun 11, 2021
Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Linear Transformers Are Secretly Fast Weight Memory Systems


Feb 23, 2021
Imanol Schlag, Kazuki Irie, Jürgen Schmidhuber

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Learning Associative Inference Using Fast Weight Memory


Nov 16, 2020
Imanol Schlag, Tsendsuren Munkhdalai, Jürgen Schmidhuber

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving


Oct 15, 2019
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
>>