Alert button
Picture for Amirhossein Kazemnejad

Amirhossein Kazemnejad

Alert button

The Impact of Positional Encoding on Length Generalization in Transformers

May 31, 2023
Amirhossein Kazemnejad, Inkit Padhi, Karthikeyan Natesan Ramamurthy, Payel Das, Siva Reddy

Figure 1 for The Impact of Positional Encoding on Length Generalization in Transformers
Figure 2 for The Impact of Positional Encoding on Length Generalization in Transformers
Figure 3 for The Impact of Positional Encoding on Length Generalization in Transformers
Figure 4 for The Impact of Positional Encoding on Length Generalization in Transformers
Viaarxiv icon

Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models

May 24, 2023
Amirhossein Kazemnejad, Mehdi Rezagholizadeh, Prasanna Parthasarathi, Sarath Chandar

Figure 1 for Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models
Figure 2 for Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models
Figure 3 for Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models
Figure 4 for Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models
Viaarxiv icon

The Curious Case of Absolute Position Embeddings

Oct 23, 2022
Koustuv Sinha, Amirhossein Kazemnejad, Siva Reddy, Joelle Pineau, Dieuwke Hupkes, Adina Williams

Figure 1 for The Curious Case of Absolute Position Embeddings
Figure 2 for The Curious Case of Absolute Position Embeddings
Figure 3 for The Curious Case of Absolute Position Embeddings
Figure 4 for The Curious Case of Absolute Position Embeddings
Viaarxiv icon