Alert button
Picture for Peng Li

Peng Li

Alert button

Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models

Dec 14, 2021
Lei Li, Yankai Lin, Xuancheng Ren, Guangxiang Zhao, Peng Li, Jie Zhou, Xu Sun

Figure 1 for Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models
Figure 2 for Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models
Figure 3 for Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models
Figure 4 for Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models
Viaarxiv icon

Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach

Nov 16, 2021
Wenqi Zhang, Kai Zhao, Peng Li, Xiao Zhu, Faping Ye, Weijie Jiang, Huiqiao Fu, Tao Wang

Figure 1 for Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach
Figure 2 for Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach
Figure 3 for Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach
Figure 4 for Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach
Viaarxiv icon

BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks

Nov 14, 2021
Yukun Yang, Peng Li

Figure 1 for BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks
Figure 2 for BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks
Figure 3 for BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks
Figure 4 for BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks
Viaarxiv icon

On Transferability of Prompt Tuning for Natural Language Understanding

Nov 12, 2021
Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou

Figure 1 for On Transferability of Prompt Tuning for Natural Language Understanding
Figure 2 for On Transferability of Prompt Tuning for Natural Language Understanding
Figure 3 for On Transferability of Prompt Tuning for Natural Language Understanding
Figure 4 for On Transferability of Prompt Tuning for Natural Language Understanding
Viaarxiv icon

FedGraph: Federated Graph Learning with Intelligent Sampling

Nov 02, 2021
Fahao Chen, Peng Li, Toshiaki Miyazaki, Celimuge Wu

Figure 1 for FedGraph: Federated Graph Learning with Intelligent Sampling
Figure 2 for FedGraph: Federated Graph Learning with Intelligent Sampling
Figure 3 for FedGraph: Federated Graph Learning with Intelligent Sampling
Figure 4 for FedGraph: Federated Graph Learning with Intelligent Sampling
Viaarxiv icon

Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings

Oct 29, 2021
Guanglin Niu, Yang Li, Chengguang Tang, Zhongkai Hu, Shibin Yang, Peng Li, Chengyu Wang, Hao Wang, Jian Sun

Figure 1 for Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings
Figure 2 for Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings
Figure 3 for Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings
Figure 4 for Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings
Viaarxiv icon

MoEfication: Conditional Computation of Transformer Models for Efficient Inference

Oct 15, 2021
Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

Figure 1 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Figure 2 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Figure 3 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Figure 4 for MoEfication: Conditional Computation of Transformer Models for Efficient Inference
Viaarxiv icon

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning

Oct 15, 2021
Yujia Qin, Xiaozhi Wang, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou

Figure 1 for Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning
Figure 2 for Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning
Figure 3 for Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning
Figure 4 for Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning
Viaarxiv icon

RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models

Oct 15, 2021
Wenkai Yang, Yankai Lin, Peng Li, Jie Zhou, Xu Sun

Figure 1 for RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Figure 2 for RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Figure 3 for RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Figure 4 for RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Viaarxiv icon

Topology-Imbalance Learning for Semi-Supervised Node Classification

Oct 08, 2021
Deli Chen, Yankai Lin, Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun

Figure 1 for Topology-Imbalance Learning for Semi-Supervised Node Classification
Figure 2 for Topology-Imbalance Learning for Semi-Supervised Node Classification
Figure 3 for Topology-Imbalance Learning for Semi-Supervised Node Classification
Figure 4 for Topology-Imbalance Learning for Semi-Supervised Node Classification
Viaarxiv icon