Alert button
Picture for Henry Tsai

Henry Tsai

Alert button

Demystifying the Better Performance of Position Encoding Variants for Transformer

Apr 18, 2021
Pu-Chin Chen, Henry Tsai, Srinadh Bhojanapalli, Hyung Won Chung, Yin-Wen Chang, Chun-Sung Ferng

Figure 1 for Demystifying the Better Performance of Position Encoding Variants for Transformer
Figure 2 for Demystifying the Better Performance of Position Encoding Variants for Transformer
Figure 3 for Demystifying the Better Performance of Position Encoding Variants for Transformer
Figure 4 for Demystifying the Better Performance of Position Encoding Variants for Transformer
Viaarxiv icon

Rethinking embedding coupling in pre-trained language models

Oct 24, 2020
Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder

Figure 1 for Rethinking embedding coupling in pre-trained language models
Figure 2 for Rethinking embedding coupling in pre-trained language models
Figure 3 for Rethinking embedding coupling in pre-trained language models
Figure 4 for Rethinking embedding coupling in pre-trained language models
Viaarxiv icon

Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition

Aug 15, 2020
Henry Tsai, Jayden Ooi, Chun-Sung Ferng, Hyung Won Chung, Jason Riesa

Figure 1 for Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition
Figure 2 for Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition
Figure 3 for Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition
Figure 4 for Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition
Viaarxiv icon

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation

Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman

Figure 1 for Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
Figure 2 for Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
Figure 3 for Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
Figure 4 for Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
Viaarxiv icon

Small and Practical BERT Models for Sequence Labeling

Aug 31, 2019
Henry Tsai, Jason Riesa, Melvin Johnson, Naveen Arivazhagan, Xin Li, Amelia Archer

Figure 1 for Small and Practical BERT Models for Sequence Labeling
Figure 2 for Small and Practical BERT Models for Sequence Labeling
Figure 3 for Small and Practical BERT Models for Sequence Labeling
Figure 4 for Small and Practical BERT Models for Sequence Labeling
Viaarxiv icon