Picture for Eran Malach

Eran Malach

On the Power of Decision Trees in Auto-Regressive Language Modeling

Add code
Sep 27, 2024
Figure 1 for On the Power of Decision Trees in Auto-Regressive Language Modeling
Figure 2 for On the Power of Decision Trees in Auto-Regressive Language Modeling
Figure 3 for On the Power of Decision Trees in Auto-Regressive Language Modeling
Figure 4 for On the Power of Decision Trees in Auto-Regressive Language Modeling
Viaarxiv icon

Universal Length Generalization with Turing Programs

Add code
Jul 03, 2024
Viaarxiv icon

A New Perspective on Shampoo's Preconditioner

Add code
Jun 25, 2024
Viaarxiv icon

Transcendence: Generative Models Can Outperform The Experts That Train Them

Add code
Jun 17, 2024
Viaarxiv icon

The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains

Add code
Feb 16, 2024
Viaarxiv icon

Repeat After Me: Transformers are Better than State Space Models at Copying

Add code
Feb 01, 2024
Viaarxiv icon

Auto-Regressive Next-Token Predictors are Universal Learners

Add code
Sep 13, 2023
Viaarxiv icon

Pareto Frontiers in Neural Feature Learning: Data, Compute, Width, and Luck

Add code
Sep 07, 2023
Viaarxiv icon

Corgi^2: A Hybrid Offline-Online Approach To Storage-Aware Data Shuffling For SGD

Add code
Sep 04, 2023
Viaarxiv icon

SubTuning: Efficient Finetuning for Multi-Task Learning

Add code
Feb 14, 2023
Viaarxiv icon