Picture for Aman Timalsina

Aman Timalsina

Simple linear attention language models balance the recall-throughput tradeoff

Add code
Feb 28, 2024
Viaarxiv icon

Zoology: Measuring and Improving Recall in Efficient Language Models

Add code
Dec 08, 2023
Figure 1 for Zoology: Measuring and Improving Recall in Efficient Language Models
Figure 2 for Zoology: Measuring and Improving Recall in Efficient Language Models
Figure 3 for Zoology: Measuring and Improving Recall in Efficient Language Models
Figure 4 for Zoology: Measuring and Improving Recall in Efficient Language Models
Viaarxiv icon

Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions

Oct 28, 2023
Figure 1 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Figure 2 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Figure 3 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Figure 4 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Viaarxiv icon

How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections

Jun 24, 2022
Figure 1 for How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
Figure 2 for How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
Figure 3 for How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
Figure 4 for How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
Viaarxiv icon