Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

VeLO: Training Versatile Learned Optimizers by Scaling Up


Nov 17, 2022
Luke Metz, James Harrison, C. Daniel Freeman, Amil Merchant, Lucas Beyer, James Bradbury, Naman Agrawal, Ben Poole, Igor Mordatch, Adam Roberts, Jascha Sohl-Dickstein

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Learn2Hop: Learned Optimization on Rough Landscapes


Jul 20, 2021
Amil Merchant, Luke Metz, Sam Schoenholz, Ekin Dogus Cubuk

Add code

* ICML 2021, 16 pages, 8 figures, 6 tables 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Does Data Augmentation Benefit from Split BatchNorms


Oct 15, 2020
Amil Merchant, Barret Zoph, Ekin Dogus Cubuk

Add code

* 9 pages (+ 3 for references) 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

What Happens To BERT Embeddings During Fine-tuning?


Apr 29, 2020
Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, Ian Tenney

Add code

* 9 pages (not including references), 5 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email