Alert button
Picture for Peng Li

Peng Li

Alert button

MoEfication: Conditional Computation of Transformer Models for Efficient Inference

Oct 05, 2021
Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

Figure 1 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Figure 2 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Figure 3 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Figure 4 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Viaarxiv icon

Dynamic Knowledge Distillation for Pre-trained Language Models

Sep 23, 2021
Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun

Figure 1 for Dynamic Knowledge Distillation for Pre-trained Language Models
Figure 2 for Dynamic Knowledge Distillation for Pre-trained Language Models
Figure 3 for Dynamic Knowledge Distillation for Pre-trained Language Models
Figure 4 for Dynamic Knowledge Distillation for Pre-trained Language Models
Viaarxiv icon

Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation

Sep 17, 2021
Feilong Chen, Fandong Meng, Xiuyi Chen, Peng Li, Jie Zhou

Figure 1 for Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation
Figure 2 for Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation
Figure 3 for Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation
Figure 4 for Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation
Viaarxiv icon

GoG: Relation-aware Graph-over-Graph Network for Visual Dialog

Sep 17, 2021
Feilong Chen, Xiuyi Chen, Fandong Meng, Peng Li, Jie Zhou

Figure 1 for GoG: Relation-aware Graph-over-Graph Network for Visual Dialog
Figure 2 for GoG: Relation-aware Graph-over-Graph Network for Visual Dialog
Figure 3 for GoG: Relation-aware Graph-over-Graph Network for Visual Dialog
Figure 4 for GoG: Relation-aware Graph-over-Graph Network for Visual Dialog
Viaarxiv icon

WeChat Neural Machine Translation Systems for WMT21

Aug 05, 2021
Xianfeng Zeng, Yijin Liu, Ernan Li, Qiu Ran, Fandong Meng, Peng Li, Jinan Xu, Jie Zhou

Figure 1 for WeChat Neural Machine Translation Systems for WMT21
Figure 2 for WeChat Neural Machine Translation Systems for WMT21
Figure 3 for WeChat Neural Machine Translation Systems for WMT21
Figure 4 for WeChat Neural Machine Translation Systems for WMT21
Viaarxiv icon

Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization

Aug 04, 2021
Wenrui Zhang, Peng Li

Figure 1 for Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization
Figure 2 for Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization
Figure 3 for Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization
Figure 4 for Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization
Viaarxiv icon

H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks

Jul 25, 2021
Ling Liang, Zheng Qu, Zhaodong Chen, Fengbin Tu, Yujie Wu, Lei Deng, Guoqi Li, Peng Li, Yuan Xie

Figure 1 for H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks
Figure 2 for H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks
Figure 3 for H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks
Figure 4 for H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks
Viaarxiv icon

Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks

Jun 22, 2021
Yukun Yang, Wenrui Zhang, Peng Li

Figure 1 for Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks
Figure 2 for Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks
Figure 3 for Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks
Figure 4 for Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks
Viaarxiv icon

Demonstration of Panda: A Weakly Supervised Entity Matching System

Jun 21, 2021
Renzhi Wu, Prem Sakala, Peng Li, Xu Chu, Yeye He

Figure 1 for Demonstration of Panda: A Weakly Supervised Entity Matching System
Figure 2 for Demonstration of Panda: A Weakly Supervised Entity Matching System
Figure 3 for Demonstration of Panda: A Weakly Supervised Entity Matching System
Viaarxiv icon

Fully Hyperbolic Neural Networks

May 31, 2021
Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

Figure 1 for Fully Hyperbolic Neural Networks
Figure 2 for Fully Hyperbolic Neural Networks
Figure 3 for Fully Hyperbolic Neural Networks
Figure 4 for Fully Hyperbolic Neural Networks
Viaarxiv icon