Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Henry Tsai

Demystifying the Better Performance of Position Encoding Variants for Transformer


Apr 18, 2021
Pu-Chin Chen, Henry Tsai, Srinadh Bhojanapalli, Hyung Won Chung, Yin-Wen Chang, Chun-Sung Ferng

* 17 pages, 6 figures 

  Access Paper or Ask Questions

Rethinking embedding coupling in pre-trained language models


Oct 24, 2020
Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder


  Access Paper or Ask Questions

Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition


Aug 15, 2020
Henry Tsai, Jayden Ooi, Chun-Sung Ferng, Hyung Won Chung, Jason Riesa


  Access Paper or Ask Questions

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation


Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman


  Access Paper or Ask Questions

Small and Practical BERT Models for Sequence Labeling


Aug 31, 2019
Henry Tsai, Jason Riesa, Melvin Johnson, Naveen Arivazhagan, Xin Li, Amelia Archer

* 11 pages including appendices; accepted to appear at EMNLP-IJCNLP 2019 

  Access Paper or Ask Questions