Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting



DiJia Su , Bertrand Douillard , Rami Al-Rfou , Cheolho Park , Benjamin Sapp

* Accepted at ICRA 2022 

   Access Paper or Ask Questions

VN-Transformer: Rotation-Equivariant Attention for Vector Neurons



Serge Assaad , Carlton Downey , Rami Al-Rfou , Nigamaa Nayakanti , Ben Sapp


   Access Paper or Ask Questions

SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer



Tu Vu , Brian Lester , Noah Constant , Rami Al-Rfou , Daniel Cer

* 20 pages, 6 figures, 5 tables 

   Access Paper or Ask Questions

nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?



Mihir Kale , Aditya Siddhant , Noah Constant , Melvin Johnson , Rami Al-Rfou , Linting Xue

* Accepted at ACL-IJCNLP 2021 

   Access Paper or Ask Questions

ByT5: Towards a token-free future with pre-trained byte-to-byte models



Linting Xue , Aditya Barua , Noah Constant , Rami Al-Rfou , Sharan Narang , Mihir Kale , Adam Roberts , Colin Raffel


   Access Paper or Ask Questions

The Power of Scale for Parameter-Efficient Prompt Tuning



Brian Lester , Rami Al-Rfou , Noah Constant


   Access Paper or Ask Questions

Large Scale Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training



Oshin Agarwal , Heming Ge , Siamak Shakeri , Rami Al-Rfou


   Access Paper or Ask Questions

mT5: A massively multilingual pre-trained text-to-text transformer



Linting Xue , Noah Constant , Adam Roberts , Mihir Kale , Rami Al-Rfou , Aditya Siddhant , Aditya Barua , Colin Raffel


   Access Paper or Ask Questions

1
2
3
>>