Alert button
Picture for Li Dong

Li Dong

Alert button

TorchScale: Transformers at Scale

Nov 23, 2022
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei

Figure 1 for TorchScale: Transformers at Scale
Figure 2 for TorchScale: Transformers at Scale
Figure 3 for TorchScale: Transformers at Scale
Figure 4 for TorchScale: Transformers at Scale
Viaarxiv icon

Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System

Oct 27, 2022
Li Dong, Zhibin Liu, Feibo Jiang, Kezhi Wang

Figure 1 for Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System
Figure 2 for Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System
Figure 3 for Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System
Figure 4 for Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System
Viaarxiv icon

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning

Oct 26, 2022
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

Figure 1 for Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
Figure 2 for Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
Figure 3 for Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
Figure 4 for Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
Viaarxiv icon

A Unified View of Masked Image Modeling

Oct 19, 2022
Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei

Figure 1 for A Unified View of Masked Image Modeling
Figure 2 for A Unified View of Masked Image Modeling
Figure 3 for A Unified View of Masked Image Modeling
Figure 4 for A Unified View of Masked Image Modeling
Viaarxiv icon

Foundation Transformers

Oct 19, 2022
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

Figure 1 for Foundation Transformers
Figure 2 for Foundation Transformers
Figure 3 for Foundation Transformers
Figure 4 for Foundation Transformers
Viaarxiv icon

Non-Contrastive Learning Meets Language-Image Pre-Training

Oct 17, 2022
Jinghao Zhou, Li Dong, Zhe Gan, Lijuan Wang, Furu Wei

Figure 1 for Non-Contrastive Learning Meets Language-Image Pre-Training
Figure 2 for Non-Contrastive Learning Meets Language-Image Pre-Training
Figure 3 for Non-Contrastive Learning Meets Language-Image Pre-Training
Figure 4 for Non-Contrastive Learning Meets Language-Image Pre-Training
Viaarxiv icon

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation

Oct 13, 2022
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei

Figure 1 for CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
Figure 2 for CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
Figure 3 for CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
Figure 4 for CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
Viaarxiv icon

Semi-Supervised Semantic Segmentation with Cross Teacher Training

Sep 03, 2022
Hui Xiao, Li Dong, Kangkang Song, Hao Xu, Shuibo Fu, Diqun Yan, Chengbin Peng

Figure 1 for Semi-Supervised Semantic Segmentation with Cross Teacher Training
Figure 2 for Semi-Supervised Semantic Segmentation with Cross Teacher Training
Figure 3 for Semi-Supervised Semantic Segmentation with Cross Teacher Training
Figure 4 for Semi-Supervised Semantic Segmentation with Cross Teacher Training
Viaarxiv icon

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks

Aug 31, 2022
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei

Figure 1 for Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
Figure 2 for Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
Figure 3 for Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
Figure 4 for Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
Viaarxiv icon