Alert button
Picture for Stéphane d'Ascoli

Stéphane d'Ascoli

Alert button

ODEFormer: Symbolic Regression of Dynamical Systems with Transformers

Oct 09, 2023
Stéphane d'Ascoli, Sören Becker, Alexander Mathis, Philippe Schwaller, Niki Kilbertus

Viaarxiv icon

Boolformer: Symbolic Regression of Logic Functions with Transformers

Sep 21, 2023
Stéphane d'Ascoli, Samy Bengio, Josh Susskind, Emmanuel Abbé

Viaarxiv icon

Length Generalization in Arithmetic Transformers

Jun 27, 2023
Samy Jelassi, Stéphane d'Ascoli, Carles Domingo-Enrich, Yuhuai Wu, Yuanzhi Li, François Charton

Figure 1 for Length Generalization in Arithmetic Transformers
Figure 2 for Length Generalization in Arithmetic Transformers
Figure 3 for Length Generalization in Arithmetic Transformers
Figure 4 for Length Generalization in Arithmetic Transformers
Viaarxiv icon

End-to-end symbolic regression with transformers

Apr 22, 2022
Pierre-Alexandre Kamienny, Stéphane d'Ascoli, Guillaume Lample, François Charton

Figure 1 for End-to-end symbolic regression with transformers
Figure 2 for End-to-end symbolic regression with transformers
Figure 3 for End-to-end symbolic regression with transformers
Figure 4 for End-to-end symbolic regression with transformers
Viaarxiv icon

Optimal learning rate schedules in high-dimensional non-convex optimization problems

Feb 09, 2022
Stéphane d'Ascoli, Maria Refinetti, Giulio Biroli

Figure 1 for Optimal learning rate schedules in high-dimensional non-convex optimization problems
Figure 2 for Optimal learning rate schedules in high-dimensional non-convex optimization problems
Figure 3 for Optimal learning rate schedules in high-dimensional non-convex optimization problems
Figure 4 for Optimal learning rate schedules in high-dimensional non-convex optimization problems
Viaarxiv icon

Deep Symbolic Regression for Recurrent Sequences

Jan 12, 2022
Stéphane d'Ascoli, Pierre-Alexandre Kamienny, Guillaume Lample, François Charton

Figure 1 for Deep Symbolic Regression for Recurrent Sequences
Figure 2 for Deep Symbolic Regression for Recurrent Sequences
Figure 3 for Deep Symbolic Regression for Recurrent Sequences
Figure 4 for Deep Symbolic Regression for Recurrent Sequences
Viaarxiv icon

Transformed CNNs: recasting pre-trained convolutional layers with self-attention

Jun 10, 2021
Stéphane d'Ascoli, Levent Sagun, Giulio Biroli, Ari Morcos

Figure 1 for Transformed CNNs: recasting pre-trained convolutional layers with self-attention
Figure 2 for Transformed CNNs: recasting pre-trained convolutional layers with self-attention
Figure 3 for Transformed CNNs: recasting pre-trained convolutional layers with self-attention
Figure 4 for Transformed CNNs: recasting pre-trained convolutional layers with self-attention
Viaarxiv icon

ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases

Mar 19, 2021
Stéphane d'Ascoli, Hugo Touvron, Matthew Leavitt, Ari Morcos, Giulio Biroli, Levent Sagun

Figure 1 for ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
Figure 2 for ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
Figure 3 for ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
Figure 4 for ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
Viaarxiv icon

More data or more parameters? Investigating the effect of data structure on generalization

Mar 09, 2021
Stéphane d'Ascoli, Marylou Gabrié, Levent Sagun, Giulio Biroli

Figure 1 for More data or more parameters? Investigating the effect of data structure on generalization
Figure 2 for More data or more parameters? Investigating the effect of data structure on generalization
Figure 3 for More data or more parameters? Investigating the effect of data structure on generalization
Figure 4 for More data or more parameters? Investigating the effect of data structure on generalization
Viaarxiv icon

The dynamics of learning with feedback alignment

Nov 24, 2020
Maria Refinetti, Stéphane d'Ascoli, Ruben Ohana, Sebastian Goldt

Figure 1 for The dynamics of learning with feedback alignment
Figure 2 for The dynamics of learning with feedback alignment
Figure 3 for The dynamics of learning with feedback alignment
Figure 4 for The dynamics of learning with feedback alignment
Viaarxiv icon