Alert button
Picture for Zachary DeVito

Zachary DeVito

Alert button

Facebook AI

Generative AI Beyond LLMs: System Implications of Multi-Modal Generation

Dec 22, 2023
Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu

Viaarxiv icon

MAD Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems

Oct 18, 2023
Samuel Hsia, Alicia Golden, Bilge Acun, Newsha Ardalani, Zachary DeVito, Gu-Yeon Wei, David Brooks, Carole-Jean Wu

Viaarxiv icon

A Theory on Adam Instability in Large-Scale Machine Learning

Apr 25, 2023
Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang

Figure 1 for A Theory on Adam Instability in Large-Scale Machine Learning
Figure 2 for A Theory on Adam Instability in Large-Scale Machine Learning
Figure 3 for A Theory on Adam Instability in Large-Scale Machine Learning
Figure 4 for A Theory on Adam Instability in Large-Scale Machine Learning
Viaarxiv icon

torch.fx: Practical Program Capture and Transformation for Deep Learning in Python

Dec 15, 2021
James K. Reed, Zachary DeVito, Horace He, Ansley Ussery, Jason Ansel

Figure 1 for torch.fx: Practical Program Capture and Transformation for Deep Learning in Python
Figure 2 for torch.fx: Practical Program Capture and Transformation for Deep Learning in Python
Figure 3 for torch.fx: Practical Program Capture and Transformation for Deep Learning in Python
Figure 4 for torch.fx: Practical Program Capture and Transformation for Deep Learning in Python
Viaarxiv icon

Using Python for Model Inference in Deep Learning

Apr 01, 2021
Zachary DeVito, Jason Ansel, Will Constable, Michael Suo, Ailing Zhang, Kim Hazelwood

Figure 1 for Using Python for Model Inference in Deep Learning
Figure 2 for Using Python for Model Inference in Deep Learning
Figure 3 for Using Python for Model Inference in Deep Learning
Figure 4 for Using Python for Model Inference in Deep Learning
Viaarxiv icon

Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions

Jun 29, 2018
Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen

Figure 1 for Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions
Figure 2 for Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions
Figure 3 for Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions
Figure 4 for Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions
Viaarxiv icon

Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging

Sep 09, 2017
Zachary DeVito, Michael Mara, Michael Zollhöfer, Gilbert Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, Matthias Nießner

Figure 1 for Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
Figure 2 for Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
Figure 3 for Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
Figure 4 for Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
Viaarxiv icon