Alert button
Picture for Dahua Lin

Dahua Lin

Alert button

Balanced Data Sampling for Language Model Training with Clustering

Feb 22, 2024
Yunfan Shao, Linyang Li, Zhaoye Fei, Hang Yan, Dahua Lin, Xipeng Qiu

Viaarxiv icon

LongWanjuan: Towards Systematic Measurement for Long Text Quality

Feb 22, 2024
Kai Lv, Xiaoran Liu, Qipeng Guo, Hang Yan, Conghui He, Xipeng Qiu, Dahua Lin

Viaarxiv icon

Turn Waste into Worth: Rectifying Top-$k$ Router of MoE

Feb 21, 2024
Zhiyuan Zeng, Qipeng Guo, Zhaoye Fei, Zhangyue Yin, Yunhua Zhou, Linyang Li, Tianxiang Sun, Hang Yan, Dahua Lin, Xipeng Qiu

Viaarxiv icon

Identifying Semantic Induction Heads to Understand In-Context Learning

Feb 20, 2024
Jie Ren, Qipeng Guo, Hang Yan, Dongrui Liu, Xipeng Qiu, Dahua Lin

Viaarxiv icon

Code Needs Comments: Enhancing Code LLMs with Comment Augmentation

Feb 20, 2024
Demin Song, Honglin Guo, Yunhua Zhou, Shuhao Xing, Yudong Wang, Zifan Song, Wenwei Zhang, Qipeng Guo, Hang Yan, Xipeng Qiu, Dahua Lin

Viaarxiv icon

Mixed Gaussian Flow for Diverse Trajectory Prediction

Feb 19, 2024
Jiahe Chen, Jinkun Cao, Dahua Lin, Kris Kitani, Jiangmiao Pang

Viaarxiv icon

SepRep-Net: Multi-source Free Domain Adaptation via Model Separation And Reparameterization

Feb 13, 2024
Ying Jin, Jiaqi Wang, Dahua Lin

Viaarxiv icon

InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning

Feb 09, 2024
Huaiyuan Ying, Shuo Zhang, Linyang Li, Zhejian Zhou, Yunfan Shao, Zhaoye Fei, Yichuan Ma, Jiawei Hong, Kuikun Liu, Ziyi Wang, Yudong Wang, Zijian Wu, Shuaibin Li, Fengzhe Zhou, Hongwei Liu, Songyang Zhang, Wenwei Zhang, Hang Yan, Xipeng Qiu, Jiayu Wang, Kai Chen, Dahua Lin

Viaarxiv icon

SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models

Feb 08, 2024
Lijun Li, Bowen Dong, Ruohui Wang, Xuhao Hu, Wangmeng Zuo, Dahua Lin, Yu Qiao, Jing Shao

Viaarxiv icon

LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256K

Feb 06, 2024
Tao Yuan, Xuefei Ning, Dong Zhou, Zhijie Yang, Shiyao Li, Minghui Zhuang, Zheyue Tan, Zhuyu Yao, Dahua Lin, Boxun Li, Guohao Dai, Shengen Yan, Yu Wang

Viaarxiv icon