Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Philip Pham

ReadTwice: Reading Very Large Documents with Memories

May 11, 2021
Yury Zemlyanskiy, Joshua Ainslie, Michiel de Jong, Philip Pham, Ilya Eckstein, Fei Sha

* To appear in the proceedings of NAACL 2021 

  Access Paper or Ask Questions

OmniNet: Omnidirectional Representations from Transformers

Mar 01, 2021
Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler

  Access Paper or Ask Questions

Long Range Arena: A Benchmark for Efficient Transformers

Nov 08, 2020
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler

  Access Paper or Ask Questions

Big Bird: Transformers for Longer Sequences

Jul 28, 2020
Manzil Zaheer, Guru Guruganesh, Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, Amr Ahmed

  Access Paper or Ask Questions

Fair Hierarchical Clustering

Jun 19, 2020
Sara Ahmadian, Alessandro Epasto, Marina Knittel, Ravi Kumar, Mohammad Mahdian, Benjamin Moseley, Philip Pham, Sergei Vassilvitskii, Yuyan Wang

  Access Paper or Ask Questions

ETC: Encoding Long and Structured Data in Transformers

Apr 21, 2020
Joshua Ainslie, Santiago Ontanon, Chris Alberti, Philip Pham, Anirudh Ravula, Sumit Sanghai

* Updated ETC 512 results which mistakenly used a stale input format. Paper has not been peer-reviewed. An extended version will be submitted for review in the future 

  Access Paper or Ask Questions