Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Language Models are General-Purpose Interfaces



Yaru Hao , Haoyu Song , Li Dong , Shaohan Huang , Zewen Chi , Wenhui Wang , Shuming Ma , Furu Wei

* 32 pages. The first three authors contribute equally 

   Access Paper or Ask Questions

On the Representation Collapse of Sparse Mixture of Experts



Zewen Chi , Li Dong , Shaohan Huang , Damai Dai , Shuming Ma , Barun Patra , Saksham Singhal , Payal Bajaj , Xia Song , Furu Wei


   Access Paper or Ask Questions

StableMoE: Stable Routing Strategy for Mixture of Experts



Damai Dai , Li Dong , Shuming Ma , Bo Zheng , Zhifang Sui , Baobao Chang , Furu Wei

* ACL-2022 

   Access Paper or Ask Questions

DeepNet: Scaling Transformers to 1,000 Layers



Hongyu Wang , Shuming Ma , Li Dong , Shaohan Huang , Dongdong Zhang , Furu Wei

* Work in progress 

   Access Paper or Ask Questions

Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt



Lianzhe Huang , Shuming Ma , Dongdong Zhang , Furu Wei , Houfeng Wang


   Access Paper or Ask Questions

A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model



Xin Sun , Tao Ge , Shuming Ma , Jingjing Li , Furu Wei , Houfeng Wang


   Access Paper or Ask Questions

Phrase-level Adversarial Example Generation for Neural Machine Translation



Juncheng Wan , Jian Yang , Shuming Ma , Dongdong Zhang , Weinan Zhang , Yong Yu , Furu Wei


   Access Paper or Ask Questions

SMDT: Selective Memory-Augmented Neural Document Translation



Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei


   Access Paper or Ask Questions

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task



Jian Yang , Shuming Ma , Haoyang Huang , Dongdong Zhang , Li Dong , Shaohan Huang , Alexandre Muzio , Saksham Singhal , Hany Hassan Awadalla , Xia Song , Furu Wei

* WMT21 

   Access Paper or Ask Questions

Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation



Guanhua Chen , Shuming Ma , Yun Chen , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

* Preprint 

   Access Paper or Ask Questions

1
2
3
4
5
>>