Alert button
Picture for Qihuang Zhong

Qihuang Zhong

Alert button

Revisiting Knowledge Distillation for Autoregressive Language Models

Feb 19, 2024
Qihuang Zhong, Liang Ding, Li Shen, Juhua Liu, Bo Du, Dacheng Tao

Viaarxiv icon

ROSE Doesn't Do That: Boosting the Safety of Instruction-Tuned Large Language Models with Reverse Prompt Contrastive Decoding

Feb 19, 2024
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao

Viaarxiv icon

Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models

Oct 20, 2023
Miaoxi Zhu, Qihuang Zhong, Li Shen, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao

Viaarxiv icon

Self-Evolution Learning for Discriminative Language Model Pretraining

May 24, 2023
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao

Figure 1 for Self-Evolution Learning for Discriminative Language Model Pretraining
Figure 2 for Self-Evolution Learning for Discriminative Language Model Pretraining
Figure 3 for Self-Evolution Learning for Discriminative Language Model Pretraining
Figure 4 for Self-Evolution Learning for Discriminative Language Model Pretraining
Viaarxiv icon

Revisiting Token Dropping Strategy in Efficient BERT Pretraining

May 24, 2023
Qihuang Zhong, Liang Ding, Juhua Liu, Xuebo Liu, Min Zhang, Bo Du, Dacheng Tao

Figure 1 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Figure 2 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Figure 3 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Figure 4 for Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Viaarxiv icon

Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks

May 22, 2023
Haoqi Zheng, Qihuang Zhong, Liang Ding, Zhiliang Tian, Xin Niu, Dongsheng Li, Dacheng Tao

Figure 1 for Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks
Figure 2 for Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks
Figure 3 for Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks
Figure 4 for Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks
Viaarxiv icon

Towards Making the Most of ChatGPT for Machine Translation

Mar 24, 2023
Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, Dacheng Tao

Figure 1 for Towards Making the Most of ChatGPT for Machine Translation
Figure 2 for Towards Making the Most of ChatGPT for Machine Translation
Figure 3 for Towards Making the Most of ChatGPT for Machine Translation
Figure 4 for Towards Making the Most of ChatGPT for Machine Translation
Viaarxiv icon

Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

Mar 02, 2023
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao

Figure 1 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Figure 2 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Figure 3 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Figure 4 for Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Viaarxiv icon

AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks

Mar 01, 2023
Hao Sun, Li Shen, Qihuang Zhong, Liang Ding, Shixiang Chen, Jingwei Sun, Jing Li, Guangzhong Sun, Dacheng Tao

Figure 1 for AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks
Figure 2 for AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks
Figure 3 for AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks
Figure 4 for AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks
Viaarxiv icon