Picture for Muhammad ElNokrashy

Muhammad ElNokrashy

Microsoft ATL Cairo

Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

Sep 30, 2022
Muhammad ElNokrashy, Badr AlKhamissi, Mona Diab

Figure 1 for Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

Figure 2 for Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

Figure 3 for Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

Figure 4 for Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

* 7 pages, 7 figures

Access Paper or Ask Questions

Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation

Aug 11, 2022
Muhammad ElNokrashy, Amr Hendy, Mohamed Maher, Mohamed Afify, Hany Hassan Awadalla

Figure 1 for Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation

Figure 2 for Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation

Figure 3 for Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation

Figure 4 for Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation

* 10 pages, accepted at AMTA-2022 (Association for Machine Translation in the Americas Conference)

Access Paper or Ask Questions

The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL

Apr 07, 2021
Badr AlKhamissi, Muhammad ElNokrashy, Michael Spranger

Figure 1 for The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL

Figure 2 for The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL

Figure 3 for The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL

* This work was accepted at the Learning to Learn Workshop (ICLR 2021)

Access Paper or Ask Questions

Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

Mar 01, 2021
Badr AlKhamissi, Mohamed Gabr, Muhammad ElNokrashy, Khaled Essam

Figure 1 for Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

Figure 2 for Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

Figure 3 for Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

Figure 4 for Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

* This work was accepted at the Sixth Arabic Natural Language Processing Workshop (EACL/WANLP 2021)

Access Paper or Ask Questions