Picture for Qihuang Zhong

Qihuang Zhong

Self-Evolution Learning for Discriminative Language Model Pretraining

May 24, 2023
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao

Figure 1 for Self-Evolution Learning for Discriminative Language Model Pretraining

Figure 2 for Self-Evolution Learning for Discriminative Language Model Pretraining

Figure 3 for Self-Evolution Learning for Discriminative Language Model Pretraining

Figure 4 for Self-Evolution Learning for Discriminative Language Model Pretraining

* Accepted to Findings of ACL2023

Access Paper or Ask Questions

Revisiting Token Dropping Strategy in Efficient BERT Pretraining

May 24, 2023
Qihuang Zhong, Liang Ding, Juhua Liu, Xuebo Liu, Min Zhang, Bo Du, Dacheng Tao

Figure 1 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining

Figure 2 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining

Figure 3 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining

Figure 4 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining

* Accepted to ACL2023 Main Conference

Access Paper or Ask Questions

Towards Making the Most of ChatGPT for Machine Translation

Mar 24, 2023
Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, Dacheng Tao

Figure 1 for Towards Making the Most of ChatGPT for Machine Translation

Figure 2 for Towards Making the Most of ChatGPT for Machine Translation

Figure 3 for Towards Making the Most of ChatGPT for Machine Translation

Figure 4 for Towards Making the Most of ChatGPT for Machine Translation

* Work in progress, 9 pages

Access Paper or Ask Questions

Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

Mar 02, 2023
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao

Figure 1 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

Figure 2 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

Figure 3 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

Figure 4 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

* Work in progress. Added results of advanced prompting strategies, e.g., CoT. (19 pages)

Access Paper or Ask Questions

Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE

Feb 18, 2023
Qihuang Zhong, Liang Ding, Keqin Peng, Juhua Liu, Bo Du, Li Shen, Yibing Zhan, Dacheng Tao

Figure 1 for Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE

Figure 2 for Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE

Figure 3 for Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE

Figure 4 for Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE

* Technical report. arXiv admin note: text overlap with arXiv:2212.01853

Access Paper or Ask Questions

Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

Oct 11, 2022
Qihuang Zhong, Liang Ding, Li Shen, Peng Mi, Juhua Liu, Bo Du, Dacheng Tao

Figure 1 for Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

Figure 2 for Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

Figure 3 for Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

Figure 4 for Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

* Accepted by EMNLP 2022 (Findings)

Access Paper or Ask Questions