Understanding Counting in Small Transformers: The Interplay between Attention and Feed-Forward Layers

Add code
Jul 16, 2024
Figure 1 for Understanding Counting in Small Transformers: The Interplay between Attention and Feed-Forward Layers
Figure 2 for Understanding Counting in Small Transformers: The Interplay between Attention and Feed-Forward Layers
Figure 3 for Understanding Counting in Small Transformers: The Interplay between Attention and Feed-Forward Layers
Figure 4 for Understanding Counting in Small Transformers: The Interplay between Attention and Feed-Forward Layers

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: