Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Learning Weakly-Supervised Contrastive Representations



Yao-Hung Hubert Tsai , Tianqin Li , Weixin Liu , Peiyuan Liao , Ruslan Salakhutdinov , Louis-Philippe Morency

* Published as ICLR 2022. arXiv admin note: substantial text overlap with arXiv:2106.02869 

   Access Paper or Ask Questions

ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation



Shuohuan Wang , Yu Sun , Yang Xiang , Zhihua Wu , Siyu Ding , Weibao Gong , Shikun Feng , Junyuan Shang , Yanbin Zhao , Chao Pang , Jiaxiang Liu , Xuyi Chen , Yuxiang Lu , Weixin Liu , Xi Wang , Yangfan Bai , Qiuliang Chen , Li Zhao , Shiyong Li , Peng Sun , Dianhai Yu , Yanjun Ma , Hao Tian , Hua Wu , Tian Wu , Wei Zeng , Ge Li , Wen Gao , Haifeng Wang

* arXiv admin note: text overlap with arXiv:2107.02137 

   Access Paper or Ask Questions

ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation



Yu Sun , Shuohuan Wang , Shikun Feng , Siyu Ding , Chao Pang , Junyuan Shang , Jiaxiang Liu , Xuyi Chen , Yanbin Zhao , Yuxiang Lu , Weixin Liu , Zhihua Wu , Weibao Gong , Jianzhong Liang , Zhizhou Shang , Peng Sun , Wei Liu , Xuan Ouyang , Dianhai Yu , Hao Tian , Hua Wu , Haifeng Wang


   Access Paper or Ask Questions

Integrating Auxiliary Information in Self-supervised Learning



Yao-Hung Hubert Tsai , Tianqin Li , Weixin Liu , Peiyuan Liao , Ruslan Salakhutdinov , Louis-Philippe Morency


   Access Paper or Ask Questions

ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression



Weiyue Su , Xuyi Chen , Shikun Feng , Jiaxiang Liu , Weixin Liu , Yu Sun , Hao Tian , Hua Wu , Haifeng Wang


   Access Paper or Ask Questions