Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation


Mar 22, 2023
Daixuan Cheng, Shaohan Huang, Junyu Bi, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang

Add code

* Update link to our model and code 

   Access Paper or Ask Questions

Language Is Not All You Need: Aligning Perception with Language Models


Mar 01, 2023
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei

Add code


   Access Paper or Ask Questions

A Length-Extrapolatable Transformer


Dec 20, 2022
Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei

Add code

* 9 pages 

   Access Paper or Ask Questions

GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator


Dec 20, 2022
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Zhoujun Li, Furu Wei

Add code


   Access Paper or Ask Questions

TorchScale: Transformers at Scale


Nov 23, 2022
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei

Add code

* Work in progress 

   Access Paper or Ask Questions

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning


Oct 26, 2022
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

Add code

* Work in progress 

   Access Paper or Ask Questions

Foundation Transformers


Oct 19, 2022
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

Add code

* Work in progress 

   Access Paper or Ask Questions

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation


Oct 13, 2022
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei

Add code

* 10 pages 

   Access Paper or Ask Questions

1
2
3
4
5
>>