Alert button
Picture for Mehdi Bennani

Mehdi Bennani

Alert button

Randomized Positional Encodings Boost Length Generalization of Transformers

May 26, 2023
Anian Ruoss, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Róbert Csordás, Mehdi Bennani, Shane Legg, Joel Veness

Figure 1 for Randomized Positional Encodings Boost Length Generalization of Transformers
Figure 2 for Randomized Positional Encodings Boost Length Generalization of Transformers
Figure 3 for Randomized Positional Encodings Boost Length Generalization of Transformers
Figure 4 for Randomized Positional Encodings Boost Length Generalization of Transformers
Viaarxiv icon

A Generalist Neural Algorithmic Learner

Sep 22, 2022
Borja Ibarz, Vitaly Kurin, George Papamakarios, Kyriacos Nikiforou, Mehdi Bennani, Róbert Csordás, Andrew Dudzik, Matko Bošnjak, Alex Vitvitskyi, Yulia Rubanova, Andreea Deac, Beatrice Bevilacqua, Yaroslav Ganin, Charles Blundell, Petar Veličković

Figure 1 for A Generalist Neural Algorithmic Learner
Figure 2 for A Generalist Neural Algorithmic Learner
Figure 3 for A Generalist Neural Algorithmic Learner
Figure 4 for A Generalist Neural Algorithmic Learner
Viaarxiv icon

A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix

Oct 07, 2020
Thang Doan, Mehdi Bennani, Bogdan Mazoure, Guillaume Rabusseau, Pierre Alquier

Figure 1 for A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix
Figure 2 for A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix
Figure 3 for A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix
Figure 4 for A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix
Viaarxiv icon