Alert button
Picture for Maximilian Golub

Maximilian Golub

Alert button

Microscaling Data Formats for Deep Learning

Oct 19, 2023
Bita Darvish Rouhani, Ritchie Zhao, Ankit More, Mathew Hall, Alireza Khodamoradi, Summer Deng, Dhruv Choudhary, Marius Cornea, Eric Dellinger, Kristof Denolf, Stosic Dusan, Venmugil Elango, Maximilian Golub, Alexander Heinecke, Phil James-Roxby, Dharmesh Jani, Gaurav Kolhe, Martin Langhammer, Ada Li, Levi Melnick, Maral Mesmakhosroshahi, Andres Rodriguez, Michael Schulte, Rasoul Shafipour, Lei Shao, Michael Siu, Pradeep Dubey, Paulius Micikevicius, Maxim Naumov, Colin Verrilli, Ralph Wittig, Doug Burger, Eric Chung

Figure 1 for Microscaling Data Formats for Deep Learning
Figure 2 for Microscaling Data Formats for Deep Learning
Figure 3 for Microscaling Data Formats for Deep Learning
Figure 4 for Microscaling Data Formats for Deep Learning
Viaarxiv icon

Shared Microexponents: A Little Shifting Goes a Long Way

Feb 16, 2023
Bita Rouhani, Ritchie Zhao, Venmugil Elango, Rasoul Shafipour, Mathew Hall, Maral Mesmakhosroshahi, Ankit More, Levi Melnick, Maximilian Golub, Girish Varatkar, Lei Shao, Gaurav Kolhe, Dimitry Melts, Jasmine Klar, Renee L'Heureux, Matt Perry, Doug Burger, Eric Chung, Zhaoxia Deng, Sam Naghshineh, Jongsoo Park, Maxim Naumov

Figure 1 for Shared Microexponents: A Little Shifting Goes a Long Way
Figure 2 for Shared Microexponents: A Little Shifting Goes a Long Way
Figure 3 for Shared Microexponents: A Little Shifting Goes a Long Way
Figure 4 for Shared Microexponents: A Little Shifting Goes a Long Way
Viaarxiv icon

Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training

Sep 23, 2020
Dingqing Yang, Amin Ghasemazar, Xiaowei Ren, Maximilian Golub, Guy Lemieux, Mieszko Lis

Figure 1 for Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training
Figure 2 for Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training
Figure 3 for Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training
Figure 4 for Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training
Viaarxiv icon

DropBack: Continuous Pruning During Training

Jun 11, 2018
Maximilian Golub, Guy Lemieux, Mieszko Lis

Figure 1 for DropBack: Continuous Pruning During Training
Figure 2 for DropBack: Continuous Pruning During Training
Figure 3 for DropBack: Continuous Pruning During Training
Figure 4 for DropBack: Continuous Pruning During Training
Viaarxiv icon