Alert button
Picture for Wenyu Du

Wenyu Du

Alert button

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers

Feb 26, 2024
Ka Man Lo, Yiming Liang, Wenyu Du, Yuantao Fan, Zili Wang, Wenhao Huang, Lei Ma, Jie Fu

Viaarxiv icon

f-Divergence Minimization for Sequence-Level Knowledge Distillation

Jul 27, 2023
Yuqiao Wen, Zichao Li, Wenyu Du, Lili Mou

Figure 1 for f-Divergence Minimization for Sequence-Level Knowledge Distillation
Figure 2 for f-Divergence Minimization for Sequence-Level Knowledge Distillation
Figure 3 for f-Divergence Minimization for Sequence-Level Knowledge Distillation
Figure 4 for f-Divergence Minimization for Sequence-Level Knowledge Distillation
Viaarxiv icon

Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing

Jan 18, 2023
Jinyang Li, Binyuan Hui, Reynold Cheng, Bowen Qin, Chenhao Ma, Nan Huo, Fei Huang, Wenyu Du, Luo Si, Yongbin Li

Figure 1 for Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
Figure 2 for Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
Figure 3 for Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
Figure 4 for Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
Viaarxiv icon

Optimizing Stock Option Forecasting with the Assembly of Machine Learning Models and Improved Trading Strategies

Nov 29, 2022
Zheng Cao, Raymond Guo, Wenyu Du, Jiayi Gao, Kirill V. Golubnichiy

Figure 1 for Optimizing Stock Option Forecasting with the Assembly of Machine Learning Models and Improved Trading Strategies
Figure 2 for Optimizing Stock Option Forecasting with the Assembly of Machine Learning Models and Improved Trading Strategies
Viaarxiv icon

Application of Convolutional Neural Networks with Quasi-Reversibility Method Results for Option Forecasting

Aug 25, 2022
Zheng Cao, Wenyu Du, Kirill V. Golubnichiy

Figure 1 for Application of Convolutional Neural Networks with Quasi-Reversibility Method Results for Option Forecasting
Figure 2 for Application of Convolutional Neural Networks with Quasi-Reversibility Method Results for Option Forecasting
Figure 3 for Application of Convolutional Neural Networks with Quasi-Reversibility Method Results for Option Forecasting
Figure 4 for Application of Convolutional Neural Networks with Quasi-Reversibility Method Results for Option Forecasting
Viaarxiv icon

Linguistic dependencies and statistical dependence

Apr 18, 2021
Jacob Louis Hoover, Alessandro Sordoni, Wenyu Du, Timothy J. O'Donnell

Figure 1 for Linguistic dependencies and statistical dependence
Figure 2 for Linguistic dependencies and statistical dependence
Figure 3 for Linguistic dependencies and statistical dependence
Figure 4 for Linguistic dependencies and statistical dependence
Viaarxiv icon

Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach

May 12, 2020
Wenyu Du, Zhouhan Lin, Yikang Shen, Timothy J. O'Donnell, Yoshua Bengio, Yue Zhang

Figure 1 for Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach
Figure 2 for Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach
Figure 3 for Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach
Figure 4 for Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach
Viaarxiv icon

GPSP: Graph Partition and Space Projection based Approach for Heterogeneous Network Embedding

Mar 07, 2018
Wenyu Du, Shuai Yu, Min Yang, Qiang Qu, Jia Zhu

Figure 1 for GPSP: Graph Partition and Space Projection based Approach for Heterogeneous Network Embedding
Figure 2 for GPSP: Graph Partition and Space Projection based Approach for Heterogeneous Network Embedding
Viaarxiv icon