Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers



Rui Liu , Young Jin Kim , Alexandre Muzio , Barzan Mozafari , Hany Hassan Awadalla

* Accepted to ICML 2022 

   Access Paper or Ask Questions

Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs



Amr Hendy , Esraa A. Gad , Mohamed Abdelghaffar , Jailan S. ElMosalami , Mohamed Afify , Ahmed Y. Tawfik , Hany Hassan Awadalla


   Access Paper or Ask Questions

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task



Jian Yang , Shuming Ma , Haoyang Huang , Dongdong Zhang , Li Dong , Shaohan Huang , Alexandre Muzio , Saksham Singhal , Hany Hassan Awadalla , Xia Song , Furu Wei

* WMT21 

   Access Paper or Ask Questions

Scalable and Efficient MoE Training for Multitask Multilingual Models



Young Jin Kim , Ammar Ahmad Awan , Alexandre Muzio , Andres Felipe Cruz Salinas , Liyang Lu , Amr Hendy , Samyam Rajbhandari , Yuxiong He , Hany Hassan Awadalla


   Access Paper or Ask Questions

DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders



Shuming Ma , Li Dong , Shaohan Huang , Dongdong Zhang , Alexandre Muzio , Saksham Singhal , Hany Hassan Awadalla , Xia Song , Furu Wei

* Work in progress 

   Access Paper or Ask Questions

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders



Shuming Ma , Jian Yang , Haoyang Huang , Zewen Chi , Li Dong , Dongdong Zhang , Hany Hassan Awadalla , Alexandre Muzio , Akiko Eriguchi , Saksham Singhal , Xia Song , Arul Menezes , Furu Wei


   Access Paper or Ask Questions

Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions



Muhammad N. ElNokrashy , Amr Hendy , Mohamed Abdelghaffar , Mohamed Afify , Ahmed Tawfik , Hany Hassan Awadalla

* Accepted at WMT20 (EMNLP 2020 Fifth Conference on Machine Translation) 

   Access Paper or Ask Questions

FastFormers: Highly Efficient Transformer Models for Natural Language Understanding



Young Jin Kim , Hany Hassan Awadalla

* Accepted to SustaiNLP 2020 at EMNLP 2020 

   Access Paper or Ask Questions

Multi-task Learning for Multilingual Neural Machine Translation



Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

* EMNLP 2020 

   Access Paper or Ask Questions

Detecting Interrogative Utterances with Recurrent Neural Networks



Junyoung Chung , Jacob Devlin , Hany Hassan Awadalla

* 6 pages, accepted to NIPS 2015 Workshop on Machine Learning for Spoken Language Understanding and Interaction 

   Access Paper or Ask Questions