Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
Do Transformer Modifications Transfer Across Implementations and Applications?

Feb 23, 2021
Sharan Narang, Hyung Won Chung, Yi Tay, William Fedus, Thibault Fevry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel


  Access Paper or Ask Questions

Switch Spaces: Learning Product Spaces with Sparse Gating

Feb 17, 2021
Shuai Zhang, Yi Tay, Wenqi Jiang, Da-cheng Juan, Ce Zhang


  Access Paper or Ask Questions

Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters

Feb 17, 2021
Aston Zhang, Yi Tay, Shuai Zhang, Alvin Chan, Anh Tuan Luu, Siu Cheung Hui, Jie Fu

* Published as a conference paper at the 9th International Conference on Learning Representations (ICLR 2021) 

  Access Paper or Ask Questions

Label Smoothed Embedding Hypothesis for Out-of-Distribution Detection

Feb 09, 2021
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler


  Access Paper or Ask Questions

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling

Dec 15, 2020
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron Courville


  Access Paper or Ask Questions

Long Range Arena: A Benchmark for Efficient Transformers

Nov 08, 2020
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler


  Access Paper or Ask Questions

Surprise: Result List Truncation via Extreme Value Theory

Oct 19, 2020
Dara Bahri, Che Zheng, Yi Tay, Donald Metzler, Andrew Tomkins


  Access Paper or Ask Questions

Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder

Oct 06, 2020
Alvin Chan, Yi Tay, Yew-Soon Ong, Aston Zhang

* Accepted in EMNLP-Findings 2020, Camera Ready Version 

  Access Paper or Ask Questions

Efficient Transformers: A Survey

Sep 16, 2020
Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler


  Access Paper or Ask Questions

Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study

Aug 17, 2020
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Cliff Brunk, Andrew Tomkins


  Access Paper or Ask Questions

HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections

Jul 12, 2020
Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan


  Access Paper or Ask Questions

Synthesizer: Rethinking Self-Attention in Transformer Models

May 02, 2020
Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng


  Access Paper or Ask Questions

Choppy: Cut Transformer For Ranked List Truncation

Apr 26, 2020
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins

* SIGIR 2020 

  Access Paper or Ask Questions

Reverse Engineering Configurations of Neural Text Generation Models

Apr 13, 2020
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins

* ACL 2020 

  Access Paper or Ask Questions

Sparse Sinkhorn Attention

Feb 26, 2020
Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan


  Access Paper or Ask Questions

Jacobian Adversarially Regularized Networks for Robustness

Jan 29, 2020
Alvin Chan, Yi Tay, Yew Soon Ong, Jie Fu

* ICLR 2020 Camera Ready 

  Access Paper or Ask Questions

Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matching

Jan 20, 2020
Shuohang Wang, Yunshi Lan, Yi Tay, Jing Jiang, Jingjing Liu

* AAAI 2020, 8 pages 

  Access Paper or Ask Questions

What it Thinks is Important is Important: Robustness Transfers through Input Gradients

Dec 11, 2019
Alvin Chan, Yi Tay, Yew-Soon Ong


  Access Paper or Ask Questions

Interactive Machine Comprehension with Information Seeking Agents

Sep 04, 2019
Xingdi Yuan, Jie Fu, Marc-Alexandre Cote, Yi Tay, Christopher Pal, Adam Trischler


  Access Paper or Ask Questions

Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks

Jun 11, 2019
Yi Tay, Aston Zhang, Luu Anh Tuan, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu, Siu Cheung Hui

* ACL 2019 

  Access Paper or Ask Questions

Quaternion Collaborative Filtering for Recommendation

Jun 06, 2019
Shuai Zhang, Lina Yao, Lucas Vinh Tran, Aston Zhang, Yi Tay

* Accepted at IJCAI 2019 

  Access Paper or Ask Questions

Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives

May 26, 2019
Yi Tay, Shuohang Wang, Luu Anh Tuan, Jie Fu, Minh C. Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, Aston Zhang

* Accepted to ACL 2019 

  Access Paper or Ask Questions

DeepRec: An Open-source Toolkit for Deep Learning based Recommendation

May 25, 2019
Shuai Zhang, Yi Tay, Lina Yao, Bin Wu, Aixin Sun

* Accepted by IJCAI-2019 Demonstrations Track 

  Access Paper or Ask Questions

Quaternion Knowledge Graph Embedding

May 25, 2019
Shuai Zhang, Yi Tay, Lina Yao, Qi Liu

* Work in progress 

  Access Paper or Ask Questions

Recurrently Controlled Recurrent Networks

Nov 24, 2018
Yi Tay, Luu Anh Tuan, Siu Cheung Hui

* NIPS 2018 

  Access Paper or Ask Questions

Holistic Multi-modal Memory Network for Movie Question Answering

Nov 12, 2018
Anran Wang, Anh Tuan Luu, Chuan-Sheng Foo, Hongyuan Zhu, Yi Tay, Vijay Chandrasekhar


  Access Paper or Ask Questions

Densely Connected Attention Propagation for Reading Comprehension

Nov 10, 2018
Yi Tay, Luu Anh Tuan, Siu Cheung Hui, Jian Su

* NIPS 2018 

  Access Paper or Ask Questions