Alert button
Picture for Jidong Zhai

Jidong Zhai

Alert button

PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR

Jul 11, 2023
Zixuan Ma, Haojie Wang, Jingze Xing, Liyan Zheng, Chen Zhang, Huanqi Cao, Kezhao Huang, Shizhi Tang, Penghan Wang, Jidong Zhai

Figure 1 for PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR
Figure 2 for PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR
Figure 3 for PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR
Figure 4 for PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR
Viaarxiv icon

ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training

Jan 19, 2023
Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang

Figure 1 for ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Figure 2 for ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Figure 3 for ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Figure 4 for ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Viaarxiv icon

GLM-130B: An Open Bilingual Pre-trained Model

Oct 05, 2022
Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, Weng Lam Tam, Zixuan Ma, Yufei Xue, Jidong Zhai, Wenguang Chen, Peng Zhang, Yuxiao Dong, Jie Tang

Figure 1 for GLM-130B: An Open Bilingual Pre-trained Model
Figure 2 for GLM-130B: An Open Bilingual Pre-trained Model
Figure 3 for GLM-130B: An Open Bilingual Pre-trained Model
Figure 4 for GLM-130B: An Open Bilingual Pre-trained Model
Viaarxiv icon

Guiding the PLMs with Semantic Anchors as Intermediate Supervision: Towards Interpretable Semantic Parsing

Oct 04, 2022
Lunyiu Nie, Jiuding Sun, Yanlin Wang, Lun Du, Shi Han, Dongmei Zhang, Lei Hou, Juanzi Li, Jidong Zhai

Figure 1 for Guiding the PLMs with Semantic Anchors as Intermediate Supervision: Towards Interpretable Semantic Parsing
Figure 2 for Guiding the PLMs with Semantic Anchors as Intermediate Supervision: Towards Interpretable Semantic Parsing
Figure 3 for Guiding the PLMs with Semantic Anchors as Intermediate Supervision: Towards Interpretable Semantic Parsing
Figure 4 for Guiding the PLMs with Semantic Anchors as Intermediate Supervision: Towards Interpretable Semantic Parsing
Viaarxiv icon

OLLIE: Derivation-based Tensor Program Optimizer

Aug 02, 2022
Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma, Tuowei Wang, Shizhi Tang, Lei Xie, Kezhao Huang, Zhihao Jia

Figure 1 for OLLIE: Derivation-based Tensor Program Optimizer
Figure 2 for OLLIE: Derivation-based Tensor Program Optimizer
Figure 3 for OLLIE: Derivation-based Tensor Program Optimizer
Figure 4 for OLLIE: Derivation-based Tensor Program Optimizer
Viaarxiv icon

GraphQ IR: Unifying Semantic Parsing of Graph Query Language with Intermediate Representation

May 24, 2022
Lunyiu Nie, Shulin Cao, Jiaxin Shi, Qi Tian, Lei Hou, Juanzi Li, Jidong Zhai

Figure 1 for GraphQ IR: Unifying Semantic Parsing of Graph Query Language with Intermediate Representation
Figure 2 for GraphQ IR: Unifying Semantic Parsing of Graph Query Language with Intermediate Representation
Figure 3 for GraphQ IR: Unifying Semantic Parsing of Graph Query Language with Intermediate Representation
Figure 4 for GraphQ IR: Unifying Semantic Parsing of Graph Query Language with Intermediate Representation
Viaarxiv icon

A Roadmap for Big Model

Apr 02, 2022
Sha Yuan, Hanyu Zhao, Shuai Zhao, Jiahong Leng, Yangxiao Liang, Xiaozhi Wang, Jifan Yu, Xin Lv, Zhou Shao, Jiaao He, Yankai Lin, Xu Han, Zhenghao Liu, Ning Ding, Yongming Rao, Yizhao Gao, Liang Zhang, Ming Ding, Cong Fang, Yisen Wang, Mingsheng Long, Jing Zhang, Yinpeng Dong, Tianyu Pang, Peng Cui, Lingxiao Huang, Zheng Liang, Huawei Shen, Hui Zhang, Quanshi Zhang, Qingxiu Dong, Zhixing Tan, Mingxuan Wang, Shuo Wang, Long Zhou, Haoran Li, Junwei Bao, Yingwei Pan, Weinan Zhang, Zhou Yu, Rui Yan, Chence Shi, Minghao Xu, Zuobai Zhang, Guoqiang Wang, Xiang Pan, Mengjie Li, Xiaoyu Chu, Zijun Yao, Fangwei Zhu, Shulin Cao, Weicheng Xue, Zixuan Ma, Zhengyan Zhang, Shengding Hu, Yujia Qin, Chaojun Xiao, Zheni Zeng, Ganqu Cui, Weize Chen, Weilin Zhao, Yuan Yao, Peng Li, Wenzhao Zheng, Wenliang Zhao, Ziyi Wang, Borui Zhang, Nanyi Fei, Anwen Hu, Zenan Ling, Haoyang Li, Boxi Cao, Xianpei Han, Weidong Zhan, Baobao Chang, Hao Sun, Jiawen Deng, Chujie Zheng, Juanzi Li, Lei Hou, Xigang Cao, Jidong Zhai, Zhiyuan Liu, Maosong Sun, Jiwen Lu, Zhiwu Lu, Qin Jin, Ruihua Song, Ji-Rong Wen, Zhouchen Lin, Liwei Wang, Hang Su, Jun Zhu, Zhifang Sui, Jiajun Zhang, Yang Liu, Xiaodong He, Minlie Huang, Jian Tang, Jie Tang

Figure 1 for A Roadmap for Big Model
Figure 2 for A Roadmap for Big Model
Figure 3 for A Roadmap for Big Model
Figure 4 for A Roadmap for Big Model
Viaarxiv icon

FastMoE: A Fast Mixture-of-Expert Training System

Mar 24, 2021
Jiaao He, Jiezhong Qiu, Aohan Zeng, Zhilin Yang, Jidong Zhai, Jie Tang

Figure 1 for FastMoE: A Fast Mixture-of-Expert Training System
Figure 2 for FastMoE: A Fast Mixture-of-Expert Training System
Figure 3 for FastMoE: A Fast Mixture-of-Expert Training System
Figure 4 for FastMoE: A Fast Mixture-of-Expert Training System
Viaarxiv icon

AIPerf: Automated machine learning as an AI-HPC benchmark

Aug 26, 2020
Zhixiang Ren, Yongheng Liu, Tianhui Shi, Lei Xie, Yue Zhou, Jidong Zhai, Youhui Zhang, Yunquan Zhang, Wenguang Chen

Figure 1 for AIPerf: Automated machine learning as an AI-HPC benchmark
Figure 2 for AIPerf: Automated machine learning as an AI-HPC benchmark
Figure 3 for AIPerf: Automated machine learning as an AI-HPC benchmark
Figure 4 for AIPerf: Automated machine learning as an AI-HPC benchmark
Viaarxiv icon