Alert button
Picture for Chaojun Xiao

Chaojun Xiao

Alert button

Ouroboros: Speculative Decoding with Large Model Enhanced Drafting

Feb 21, 2024
Weilin Zhao, Yuxiang Huang, Xu Han, Chaojun Xiao, Zhiyuan Liu, Maosong Sun

Viaarxiv icon

InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory

Feb 07, 2024
Chaojun Xiao, Pengle Zhang, Xu Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Song Han, Maosong Sun

Viaarxiv icon

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs

Feb 06, 2024
Zhengyan Zhang, Yixin Song, Guanghui Yu, Xu Han, Yankai Lin, Chaojun Xiao, Chenyang Song, Zhiyuan Liu, Zeyu Mi, Maosong Sun

Viaarxiv icon

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules

Oct 24, 2023
Chaojun Xiao, Yuqi Luo, Wenbin Zhang, Pengle Zhang, Xu Han, Yankai Lin, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou

Figure 1 for Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
Figure 2 for Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
Figure 3 for Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
Figure 4 for Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
Viaarxiv icon

MUSER: A Multi-View Similar Case Retrieval Dataset

Oct 24, 2023
Qingquan Li, Yiran Hu, Feng Yao, Chaojun Xiao, Zhiyuan Liu, Maosong Sun, Weixing Shen

Figure 1 for MUSER: A Multi-View Similar Case Retrieval Dataset
Figure 2 for MUSER: A Multi-View Similar Case Retrieval Dataset
Figure 3 for MUSER: A Multi-View Similar Case Retrieval Dataset
Figure 4 for MUSER: A Multi-View Similar Case Retrieval Dataset
Viaarxiv icon

Thoroughly Modeling Multi-domain Pre-trained Recommendation as Language

Oct 20, 2023
Zekai Qu, Ruobing Xie, Chaojun Xiao, Yuan Yao, Zhiyuan Liu, Fengzong Lian, Zhanhui Kang, Jie Zhou

Figure 1 for Thoroughly Modeling Multi-domain Pre-trained Recommendation as Language
Figure 2 for Thoroughly Modeling Multi-domain Pre-trained Recommendation as Language
Figure 3 for Thoroughly Modeling Multi-domain Pre-trained Recommendation as Language
Figure 4 for Thoroughly Modeling Multi-domain Pre-trained Recommendation as Language
Viaarxiv icon

Emergent Modularity in Pre-trained Transformers

May 28, 2023
Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Chaojun Xiao, Xiaozhi Wang, Xu Han, Zhiyuan Liu, Ruobing Xie, Maosong Sun, Jie Zhou

Figure 1 for Emergent Modularity in Pre-trained Transformers
Figure 2 for Emergent Modularity in Pre-trained Transformers
Figure 3 for Emergent Modularity in Pre-trained Transformers
Figure 4 for Emergent Modularity in Pre-trained Transformers
Viaarxiv icon

Plug-and-Play Knowledge Injection for Pre-trained Language Models

May 28, 2023
Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Huadong Wang, Deming Ye, Chaojun Xiao, Xu Han, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

Figure 1 for Plug-and-Play Knowledge Injection for Pre-trained Language Models
Figure 2 for Plug-and-Play Knowledge Injection for Pre-trained Language Models
Figure 3 for Plug-and-Play Knowledge Injection for Pre-trained Language Models
Figure 4 for Plug-and-Play Knowledge Injection for Pre-trained Language Models
Viaarxiv icon

Plug-and-Play Document Modules for Pre-trained Models

May 28, 2023
Chaojun Xiao, Zhengyan Zhang, Xu Han, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Xiangyang Li, Zhonghua Li, Zhao Cao, Maosong Sun

Figure 1 for Plug-and-Play Document Modules for Pre-trained Models
Figure 2 for Plug-and-Play Document Modules for Pre-trained Models
Figure 3 for Plug-and-Play Document Modules for Pre-trained Models
Figure 4 for Plug-and-Play Document Modules for Pre-trained Models
Viaarxiv icon

Tool Learning with Foundation Models

Apr 17, 2023
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, Yi Ren Fung, Yusheng Su, Huadong Wang, Cheng Qian, Runchu Tian, Kunlun Zhu, Shihao Liang, Xingyu Shen, Bokai Xu, Zhen Zhang, Yining Ye, Bowen Li, Ziwei Tang, Jing Yi, Yuzhang Zhu, Zhenning Dai, Lan Yan, Xin Cong, Yaxi Lu, Weilin Zhao, Yuxiang Huang, Junxi Yan, Xu Han, Xian Sun, Dahai Li, Jason Phang, Cheng Yang, Tongshuang Wu, Heng Ji, Zhiyuan Liu, Maosong Sun

Figure 1 for Tool Learning with Foundation Models
Figure 2 for Tool Learning with Foundation Models
Figure 3 for Tool Learning with Foundation Models
Figure 4 for Tool Learning with Foundation Models
Viaarxiv icon