Alert button
Picture for Zachary Ankner

Zachary Ankner

Alert button

Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding

Feb 07, 2024
Zachary Ankner, Rishab Parthasarathy, Aniruddha Nrusimha, Christopher Rinard, Jonathan Ragan-Kelley, William Brandon

Viaarxiv icon

Striped Attention: Faster Ring Attention for Causal Transformers

Nov 15, 2023
William Brandon, Aniruddha Nrusimha, Kevin Qian, Zachary Ankner, Tian Jin, Zhiye Song, Jonathan Ragan-Kelley

Viaarxiv icon

Dynamic Masking Rate Schedules for MLM Pretraining

May 24, 2023
Zachary Ankner, Naomi Saphra, Davis Blalock, Jonathan Frankle, Matthew L. Leavitt

Figure 1 for Dynamic Masking Rate Schedules for MLM Pretraining
Figure 2 for Dynamic Masking Rate Schedules for MLM Pretraining
Figure 3 for Dynamic Masking Rate Schedules for MLM Pretraining
Figure 4 for Dynamic Masking Rate Schedules for MLM Pretraining
Viaarxiv icon

The Effect of Data Dimensionality on Neural Network Prunability

Dec 01, 2022
Zachary Ankner, Alex Renda, Gintare Karolina Dziugaite, Jonathan Frankle, Tian Jin

Figure 1 for The Effect of Data Dimensionality on Neural Network Prunability
Figure 2 for The Effect of Data Dimensionality on Neural Network Prunability
Figure 3 for The Effect of Data Dimensionality on Neural Network Prunability
Figure 4 for The Effect of Data Dimensionality on Neural Network Prunability
Viaarxiv icon

3D Neural Field Generation using Triplane Diffusion

Nov 30, 2022
J. Ryan Shue, Eric Ryan Chan, Ryan Po, Zachary Ankner, Jiajun Wu, Gordon Wetzstein

Figure 1 for 3D Neural Field Generation using Triplane Diffusion
Figure 2 for 3D Neural Field Generation using Triplane Diffusion
Figure 3 for 3D Neural Field Generation using Triplane Diffusion
Figure 4 for 3D Neural Field Generation using Triplane Diffusion
Viaarxiv icon