Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Do Current Multi-Task Optimization Methods in Deep Learning Even Help?


Sep 23, 2022
Derrick Xin, Behrooz Ghorbani, Ankush Garg, Orhan Firat, Justin Gilmer


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Data Scaling Laws in NMT: The Effect of Noise and Architecture


Feb 04, 2022
Yamini Bansal, Behrooz Ghorbani, Ankush Garg, Biao Zhang, Maxim Krikun, Colin Cherry, Behnam Neyshabur, Orhan Firat


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

A Loss Curvature Perspective on Training Instability in Deep Learning


Oct 08, 2021
Justin Gilmer, Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George Dahl, Zachary Nado, Orhan Firat

* 20 pages, 16 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Efficient and Private Federated Learning with Partially Trainable Networks


Oct 06, 2021
Hakim Sidahmed, Zheng Xu, Ankush Garg, Yuan Cao, Mingqing Chen


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Echo State Speech Recognition


Feb 18, 2021
Harsh Shrivastava, Ankush Garg, Yuan Cao, Yu Zhang, Tara Sainath


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

The geometry of integration in text classification RNNs


Oct 28, 2020
Kyle Aitken, Vinay V. Ramasesh, Ankush Garg, Yuan Cao, David Sussillo, Niru Maheswaranathan

* 9+19 pages, 30 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Echo State Neural Machine Translation


Feb 27, 2020
Ankush Garg, Yuan Cao, Qi Ge


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Machine Translation: A Literature Review


Dec 28, 2018
Ankush Garg, Mayank Agarwal

* 17 pages, 3 figures. arXiv admin note: text overlap with arXiv:1409.0473, arXiv:1508.04025, arXiv:1410.8206 by other authors 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email