Alert button
Picture for Dheevatsa Mudigere

Dheevatsa Mudigere

Alert button

Amy

High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models

Apr 12, 2021
Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang, Andrew Tulloch, Srinivas Sridharan, Xing Liu, Mustafa Ozdal, Jade Nie, Jongsoo Park, Liang Luo, Jie, Yang, Leon Gao, Dmytro Ivchenko, Aarti Basant, Yuxi Hu, Jiyan Yang, Ehsan K. Ardestani, Xiaodong Wang, Rakesh Komuravelli, Ching-Hsiang Chu, Serhat Yilmaz, Huayu Li, Jiyuan Qian, Zhuobo Feng, Yinbin Ma, Junjie Yang, Ellie Wen, Hong Li, Lin Yang, Chonglin Sun, Whitney Zhao, Krishna Dhulipala, KR Kishore, Tyler Graf, Assaf Eisenman, Kiran Kumar Matam, Adi Gangidi, Pallab Bhattacharya, Guoqiang Jerry Chen, Manoj Krishnan, Krishnakumar Nair, Petr Lapukhov, Maxim Naumov, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, Vijay Rao

Figure 1 for High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models
Figure 2 for High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models
Figure 3 for High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models
Figure 4 for High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models
Viaarxiv icon

Check-N-Run: A Checkpointing System for Training Recommendation Models

Oct 17, 2020
Assaf Eisenman, Kiran Kumar Matam, Steven Ingram, Dheevatsa Mudigere, Raghuraman Krishnamoorthi, Murali Annavaram, Krishnakumar Nair, Misha Smelyanskiy

Figure 1 for Check-N-Run: A Checkpointing System for Training Recommendation Models
Figure 2 for Check-N-Run: A Checkpointing System for Training Recommendation Models
Figure 3 for Check-N-Run: A Checkpointing System for Training Recommendation Models
Figure 4 for Check-N-Run: A Checkpointing System for Training Recommendation Models
Viaarxiv icon

SEERL: Sample Efficient Ensemble Reinforcement Learning

Jan 15, 2020
Rohan Saphal, Balaraman Ravindran, Dheevatsa Mudigere, Sasikanth Avancha, Bharat Kaul

Figure 1 for SEERL: Sample Efficient Ensemble Reinforcement Learning
Figure 2 for SEERL: Sample Efficient Ensemble Reinforcement Learning
Figure 3 for SEERL: Sample Efficient Ensemble Reinforcement Learning
Figure 4 for SEERL: Sample Efficient Ensemble Reinforcement Learning
Viaarxiv icon

Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems

Sep 25, 2019
Antonio Ginart, Maxim Naumov, Dheevatsa Mudigere, Jiyan Yang, James Zou

Figure 1 for Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
Figure 2 for Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
Figure 3 for Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
Figure 4 for Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
Viaarxiv icon

Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems

Sep 04, 2019
Hao-Jun Michael Shi, Dheevatsa Mudigere, Maxim Naumov, Jiyan Yang

Figure 1 for Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems
Figure 2 for Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems
Figure 3 for Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems
Figure 4 for Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systems
Viaarxiv icon

The Architectural Implications of Facebook's DNN-based Personalized Recommendation

Jun 18, 2019
Udit Gupta, Xiaodong Wang, Maxim Naumov, Carole-Jean Wu, Brandon Reagen, David Brooks, Bradford Cottel, Kim Hazelwood, Bill Jia, Hsien-Hsin S. Lee, Andrey Malevich, Dheevatsa Mudigere, Mikhail Smelyanskiy, Liang Xiong, Xuan Zhang

Figure 1 for The Architectural Implications of Facebook's DNN-based Personalized Recommendation
Figure 2 for The Architectural Implications of Facebook's DNN-based Personalized Recommendation
Figure 3 for The Architectural Implications of Facebook's DNN-based Personalized Recommendation
Figure 4 for The Architectural Implications of Facebook's DNN-based Personalized Recommendation
Viaarxiv icon

A Study of BFLOAT16 for Deep Learning Training

Jun 13, 2019
Dhiraj Kalamkar, Dheevatsa Mudigere, Naveen Mellempudi, Dipankar Das, Kunal Banerjee, Sasikanth Avancha, Dharma Teja Vooturi, Nataraj Jammalamadaka, Jianyu Huang, Hector Yuen, Jiyan Yang, Jongsoo Park, Alexander Heinecke, Evangelos Georganas, Sudarshan Srinivasan, Abhisek Kundu, Misha Smelyanskiy, Bharat Kaul, Pradeep Dubey

Figure 1 for A Study of BFLOAT16 for Deep Learning Training
Figure 2 for A Study of BFLOAT16 for Deep Learning Training
Figure 3 for A Study of BFLOAT16 for Deep Learning Training
Figure 4 for A Study of BFLOAT16 for Deep Learning Training
Viaarxiv icon

Deep Learning Recommendation Model for Personalization and Recommendation Systems

May 31, 2019
Maxim Naumov, Dheevatsa Mudigere, Hao-Jun Michael Shi, Jianyu Huang, Narayanan Sundaraman, Jongsoo Park, Xiaodong Wang, Udit Gupta, Carole-Jean Wu, Alisson G. Azzolini, Dmytro Dzhulgakov, Andrey Mallevich, Ilia Cherniavskii, Yinghai Lu, Raghuraman Krishnamoorthi, Ansha Yu, Volodymyr Kondratenko, Stephanie Pereira, Xianjie Chen, Wenlin Chen, Vijay Rao, Bill Jia, Liang Xiong, Misha Smelyanskiy

Figure 1 for Deep Learning Recommendation Model for Personalization and Recommendation Systems
Figure 2 for Deep Learning Recommendation Model for Personalization and Recommendation Systems
Figure 3 for Deep Learning Recommendation Model for Personalization and Recommendation Systems
Figure 4 for Deep Learning Recommendation Model for Personalization and Recommendation Systems
Viaarxiv icon