Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval



Yuxiang Lu , Yiding Liu , Jiaxiang Liu , Yunsheng Shi , Zhengjie Huang , Shikun Feng Yu Sun , Hao Tian , Hua Wu , Shuaiqiang Wang , Dawei Yin , Haifeng Wang


   Access Paper or Ask Questions

ERNIE-SPARSE: Learning Hierarchical Efficient Transformer Through Regularized Self-Attention



Yang Liu , Jiaxiang Liu , Li Chen , Yuxiang Lu , Shikun Feng , Zhida Feng , Yu Sun , Hao Tian , Hua Wu , Haifeng Wang


   Access Paper or Ask Questions

AI-enabled Automatic Multimodal Fusion of Cone-Beam CT and Intraoral Scans for Intelligent 3D Tooth-Bone Reconstruction and Clinical Applications



Jin Hao , Jiaxiang Liu , Jin Li , Wei Pan , Ruizhe Chen , Huimin Xiong , Kaiwei Sun , Hangzheng Lin , Wanlu Liu , Wanghui Ding , Jianfei Yang , Haoji Hu , Yueling Zhang , Yang Feng , Zeyu Zhao , Huikai Wu , Youyi Zheng , Bing Fang , Zuozhu Liu , Zhihe Zhao

* 30 pages, 6 figures, 3 tables 

   Access Paper or Ask Questions

ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation



Shuohuan Wang , Yu Sun , Yang Xiang , Zhihua Wu , Siyu Ding , Weibao Gong , Shikun Feng , Junyuan Shang , Yanbin Zhao , Chao Pang , Jiaxiang Liu , Xuyi Chen , Yuxiang Lu , Weixin Liu , Xi Wang , Yangfan Bai , Qiuliang Chen , Li Zhao , Shiyong Li , Peng Sun , Dianhai Yu , Yanjun Ma , Hao Tian , Hua Wu , Tian Wu , Wei Zeng , Ge Li , Wen Gao , Haifeng Wang

* arXiv admin note: text overlap with arXiv:2107.02137 

   Access Paper or Ask Questions

ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation



Yu Sun , Shuohuan Wang , Shikun Feng , Siyu Ding , Chao Pang , Junyuan Shang , Jiaxiang Liu , Xuyi Chen , Yanbin Zhao , Yuxiang Lu , Weixin Liu , Zhihua Wu , Weibao Gong , Jianzhong Liang , Zhizhou Shang , Peng Sun , Wei Liu , Xuan Ouyang , Dianhai Yu , Hao Tian , Hua Wu , Haifeng Wang


   Access Paper or Ask Questions

Pre-trained Language Model for Web-scale Retrieval in Baidu Search



Yiding Liu , Guan Huang , Jiaxiang Liu , Weixue Lu , Suqi Cheng , Yukun Li , Daiting Shi , Shuaiqiang Wang , Zhicong Cheng , Dawei Yin

* Accepted by KDD 2021 

   Access Paper or Ask Questions

ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression



Weiyue Su , Xuyi Chen , Shikun Feng , Jiaxiang Liu , Weixin Liu , Yu Sun , Hao Tian , Hua Wu , Haifeng Wang


   Access Paper or Ask Questions

Pose Discrepancy Spatial Transformer Based Feature Disentangling for Partial Aspect Angles SAR Target Recognition



Zaidao Wen , Jiaxiang Liu , Zhunga Liu , Quan Pan


   Access Paper or Ask Questions

Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models



Shuohuan Wang , Jiaxiang Liu , Xuan Ouyang , Yu Sun

* 8 pages, 2 figures, 6 tables. Accepted at Proceedings of 14th International Workshop on Semantic Evaluation (SemEval-2020) 

   Access Paper or Ask Questions

1
2
>>