Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Language Is Not All You Need: Aligning Perception with Language Models


Mar 01, 2023
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei

Add code


   Access Paper or Ask Questions

A Length-Extrapolatable Transformer


Dec 20, 2022
Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei

Add code

* 9 pages 

   Access Paper or Ask Questions

TorchScale: Transformers at Scale


Nov 23, 2022
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei

Add code

* Work in progress 

   Access Paper or Ask Questions

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning


Oct 26, 2022
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

Add code

* Work in progress 

   Access Paper or Ask Questions

Foundation Transformers


Oct 19, 2022
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

Add code

* Work in progress 

   Access Paper or Ask Questions

Language Model Decoding as Likelihood-Utility Alignment


Oct 13, 2022
Martin Josifoski, Maxime Peyrard, Frano Rajic, Jiheng Wei, Debjit Paul, Valentin Hartmann, Barun Patra, Vishrav Chaudhary, Emre Kıcıman, Boi Faltings, Robert West

Add code


   Access Paper or Ask Questions

On the Representation Collapse of Sparse Mixture of Experts


Apr 20, 2022
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei

Add code


   Access Paper or Ask Questions

On Efficiently Acquiring Annotations for Multilingual Models


Apr 03, 2022
Joel Ruben Antony Moniz, Barun Patra, Matthew R. Gormley

Add code

* ACL 2022 (Short Paper) 

   Access Paper or Ask Questions

Invariant Language Modeling


Oct 16, 2021
Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West

Add code


   Access Paper or Ask Questions

1
2
>>