Alert button
Picture for Ali Ghodsi

Ali Ghodsi

Alert button

Knowledge Distillation with Noisy Labels for Natural Language Understanding

Sep 21, 2021
Shivendra Bhardwaj, Abbas Ghaddar, Ahmad Rashid, Khalil Bibi, Chengyang Li, Ali Ghodsi, Philippe Langlais, Mehdi Rezagholizadeh

Figure 1 for Knowledge Distillation with Noisy Labels for Natural Language Understanding
Figure 2 for Knowledge Distillation with Noisy Labels for Natural Language Understanding
Figure 3 for Knowledge Distillation with Noisy Labels for Natural Language Understanding
Viaarxiv icon

How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding

Sep 20, 2021
Tianda Li, Ahmad Rashid, Aref Jafari, Pranav Sharma, Ali Ghodsi, Mehdi Rezagholizadeh

Figure 1 for How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
Figure 2 for How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
Figure 3 for How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
Figure 4 for How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
Viaarxiv icon

KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation

Sep 13, 2021
Marzieh S. Tahaei, Ella Charlaix, Vahid Partovi Nia, Ali Ghodsi, Mehdi Rezagholizadeh

Figure 1 for KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation
Figure 2 for KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation
Figure 3 for KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation
Figure 4 for KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation
Viaarxiv icon

Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey

Aug 25, 2021
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Viaarxiv icon

Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections, Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey

Aug 09, 2021
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Figure 1 for Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections, Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey
Figure 2 for Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections, Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey
Viaarxiv icon

Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey

Jul 26, 2021
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Figure 1 for Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey
Figure 2 for Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey
Figure 3 for Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey
Figure 4 for Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey
Viaarxiv icon

Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey

Jun 29, 2021
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Figure 1 for Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey
Figure 2 for Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey
Figure 3 for Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey
Figure 4 for Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey
Viaarxiv icon

Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations

Jun 27, 2021
Zeinab Hajimohammadi, Kourosh Parand, Ali Ghodsi

Figure 1 for Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations
Figure 2 for Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations
Figure 3 for Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations
Figure 4 for Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations
Viaarxiv icon

SymbolicGPT: A Generative Transformer Model for Symbolic Regression

Jun 27, 2021
Mojtaba Valipour, Bowen You, Maysum Panju, Ali Ghodsi

Figure 1 for SymbolicGPT: A Generative Transformer Model for Symbolic Regression
Figure 2 for SymbolicGPT: A Generative Transformer Model for Symbolic Regression
Figure 3 for SymbolicGPT: A Generative Transformer Model for Symbolic Regression
Figure 4 for SymbolicGPT: A Generative Transformer Model for Symbolic Regression
Viaarxiv icon

Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey

Jun 15, 2021
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Figure 1 for Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey
Figure 2 for Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey
Figure 3 for Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey
Viaarxiv icon