Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Wei Zeng

Wei Zeng

ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

Dec 23, 2021
Shuohuan Wang, Yu Sun, Yang Xiang, Zhihua Wu, Siyu Ding, Weibao Gong, Shikun Feng, Junyuan Shang, Yanbin Zhao, Chao Pang, Jiaxiang Liu, Xuyi Chen, Yuxiang Lu, Weixin Liu, Xi Wang, Yangfan Bai, Qiuliang Chen, Li Zhao, Shiyong Li, Peng Sun, Dianhai Yu, Yanjun Ma, Hao Tian, Hua Wu, Tian Wu, Wei Zeng, Ge Li, Wen Gao, Haifeng Wang

Figure 1 for ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

Figure 2 for ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

Figure 3 for ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

Figure 4 for ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

* arXiv admin note: text overlap with arXiv:2107.02137

Access Paper or Ask Questions

End-to-end Adaptive Distributed Training on PaddlePaddle

Dec 06, 2021
Yulong Ao, Zhihua Wu, Dianhai Yu, Weibao Gong, Zhiqing Kui, Minxu Zhang, Zilingfeng Ye, Liang Shen, Yanjun Ma, Tian Wu, Haifeng Wang, Wei Zeng, Chao Yang

Figure 1 for End-to-end Adaptive Distributed Training on PaddlePaddle

Figure 2 for End-to-end Adaptive Distributed Training on PaddlePaddle

Figure 3 for End-to-end Adaptive Distributed Training on PaddlePaddle

Figure 4 for End-to-end Adaptive Distributed Training on PaddlePaddle

* 16 pages, 10 figures, 4 tables

Access Paper or Ask Questions

DPT: Deformable Patch-based Transformer for Visual Recognition

Jul 30, 2021
Zhiyang Chen, Yousong Zhu, Chaoyang Zhao, Guosheng Hu, Wei Zeng, Jinqiao Wang, Ming Tang

Figure 1 for DPT: Deformable Patch-based Transformer for Visual Recognition

Figure 2 for DPT: Deformable Patch-based Transformer for Visual Recognition

Figure 3 for DPT: Deformable Patch-based Transformer for Visual Recognition

Figure 4 for DPT: Deformable Patch-based Transformer for Visual Recognition

* In Proceedings of the 29th ACM International Conference on Multimedia (MM '21)

Access Paper or Ask Questions

FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

Jul 06, 2021
Mengyang Wu, Wei Zeng, Chi-Wing Fu

Figure 1 for FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

Figure 2 for FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

Figure 3 for FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

Figure 4 for FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

Access Paper or Ask Questions

PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Apr 26, 2021
Wei Zeng, Xiaozhe Ren, Teng Su, Hui Wang, Yi Liao, Zhiwei Wang, Xin Jiang, ZhenZhang Yang, Kaisheng Wang, Xiaoda Zhang, Chen Li, Ziyan Gong, Yifan Yao, Xinjing Huang, Jun Wang, Jianfeng Yu, Qi Guo, Yue Yu, Yan Zhang, Jin Wang, Hengtao Tao, Dasen Yan, Zexuan Yi, Fang Peng, Fangqing Jiang, Han Zhang, Lingfeng Deng, Yehong Zhang, Zhe Lin, Chao Zhang, Shaojie Zhang, Mingyue Guo, Shanzhi Gu, Gaojun Fan, Yaowei Wang, Xuefeng Jin, Qun Liu, Yonghong Tian

Figure 1 for PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Figure 2 for PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Figure 3 for PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Figure 4 for PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

* The technique report for PanGu-$\alpha$

Access Paper or Ask Questions

Contrastive Neural Architecture Search with Neural Architecture Comparators

Apr 06, 2021
Yaofo Chen, Yong Guo, Qi Chen, Minli Li, Wei Zeng, Yaowei Wang, Mingkui Tan

Figure 1 for Contrastive Neural Architecture Search with Neural Architecture Comparators

Figure 2 for Contrastive Neural Architecture Search with Neural Architecture Comparators

Figure 3 for Contrastive Neural Architecture Search with Neural Architecture Comparators

Figure 4 for Contrastive Neural Architecture Search with Neural Architecture Comparators

* Accpeted by CVPR 2021. The code is available at https://github.com/chenyaofo/CTNAS

Access Paper or Ask Questions

Adaptive Class Suppression Loss for Long-Tail Object Detection

Apr 02, 2021
Tong Wang, Yousong Zhu, Chaoyang Zhao, Wei Zeng, Jinqiao Wang, Ming Tang

Figure 1 for Adaptive Class Suppression Loss for Long-Tail Object Detection

Figure 2 for Adaptive Class Suppression Loss for Long-Tail Object Detection

Figure 3 for Adaptive Class Suppression Loss for Long-Tail Object Detection

Figure 4 for Adaptive Class Suppression Loss for Long-Tail Object Detection

* CVPR2021 camera ready version

Access Paper or Ask Questions