Alert button
Picture for Geng Yuan

Geng Yuan

Alert button

Efficient Pruning of Large Language Model with Adaptive Estimation Fusion

Mar 16, 2024
Jun Liu, Chao Wu, Changdi Yang, Hao Tang, Haoye Dong, Zhenglun Kong, Geng Yuan, Wei Niu, Dong Huang, Yanzhi Wang

Viaarxiv icon

SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing

Jan 30, 2024
Sheng Li, Geng Yuan, Yue Dai, Youtao Zhang, Yanzhi Wang, Xulong Tang

Figure 1 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Figure 2 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Figure 3 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Figure 4 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Viaarxiv icon

EdgeOL: Efficient in-situ Online Learning on Edge Devices

Jan 30, 2024
Sheng Li, Geng Yuan, Yawen Wu, Yue Dai, Chao Wu, Alex K. Jones, Jingtong Hu, Yanzhi Wang, Xulong Tang

Viaarxiv icon

Zero-Space Cost Fault Tolerance for Transformer-based Language Models on ReRAM

Jan 22, 2024
Bingbing Li, Geng Yuan, Zigeng Wang, Shaoyi Huang, Hongwu Peng, Payman Behnam, Wujie Wen, Hang Liu, Caiwen Ding

Viaarxiv icon

MTS-LOF: Medical Time-Series Representation Learning via Occlusion-Invariant Features

Oct 19, 2023
Huayu Li, Ana S. Carreon-Rascon, Xiwen Chen, Geng Yuan, Ao Li

Viaarxiv icon

SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices

Sep 21, 2023
Zhengang Li, Geng Yuan, Tomoharu Yamauchi, Zabihi Masoud, Yanyue Xie, Peiyan Dong, Xulong Tang, Nobuyuki Yoshikawa, Devesh Tiwari, Yanzhi Wang, Olivia Chen

Figure 1 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Figure 2 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Figure 3 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Figure 4 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Viaarxiv icon

Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges

Sep 14, 2023
Fei Dou, Jin Ye, Geng Yuan, Qin Lu, Wei Niu, Haijian Sun, Le Guan, Guoyu Lu, Gengchen Mai, Ninghao Liu, Jin Lu, Zhengliang Liu, Zihao Wu, Chenjiao Tan, Shaochen Xu, Xianqiao Wang, Guoming Li, Lilong Chai, Sheng Li, Jin Sun, Hongyue Sun, Yunli Shao, Changying Li, Tianming Liu, Wenzhan Song

Figure 1 for Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges
Figure 2 for Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges
Figure 3 for Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges
Viaarxiv icon

Self-Ensemble Protection: Training Checkpoints Are Good Data Protectors

Nov 22, 2022
Sizhe Chen, Geng Yuan, Xinwen Cheng, Yifan Gong, Minghai Qin, Yanzhi Wang, Xiaolin Huang

Figure 1 for Self-Ensemble Protection: Training Checkpoints Are Good Data Protectors
Figure 2 for Self-Ensemble Protection: Training Checkpoints Are Good Data Protectors
Figure 3 for Self-Ensemble Protection: Training Checkpoints Are Good Data Protectors
Figure 4 for Self-Ensemble Protection: Training Checkpoints Are Good Data Protectors
Viaarxiv icon

Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training

Nov 19, 2022
Zhenglun Kong, Haoyu Ma, Geng Yuan, Mengshu Sun, Yanyue Xie, Peiyan Dong, Xin Meng, Xuan Shen, Hao Tang, Minghai Qin, Tianlong Chen, Xiaolong Ma, Xiaohui Xie, Zhangyang Wang, Yanzhi Wang

Figure 1 for Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training
Figure 2 for Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training
Figure 3 for Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training
Figure 4 for Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training
Viaarxiv icon

The Lottery Ticket Hypothesis for Vision Transformers

Nov 02, 2022
Xuan Shen, Zhenglun Kong, Minghai Qin, Peiyan Dong, Geng Yuan, Xin Meng, Hao Tang, Xiaolong Ma, Yanzhi Wang

Figure 1 for The Lottery Ticket Hypothesis for Vision Transformers
Figure 2 for The Lottery Ticket Hypothesis for Vision Transformers
Figure 3 for The Lottery Ticket Hypothesis for Vision Transformers
Figure 4 for The Lottery Ticket Hypothesis for Vision Transformers
Viaarxiv icon