Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Mohammad Shoeybi

Long-Short Transformer: Efficient Transformers for Language and Vision


Jul 27, 2021
Chen Zhu, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Anima Anandkumar, Bryan Catanzaro


  Access Paper or Ask Questions

Efficient Large-Scale Language Model Training on GPU Clusters


Apr 09, 2021
Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia


  Access Paper or Ask Questions

End-to-End Training of Neural Retrievers for Open-Domain Question Answering


Jan 02, 2021
Devendra Singh Sachan, Mostofa Patwary, Mohammad Shoeybi, Neel Kant, Wei Ping, William L Hamilton, Bryan Catanzaro

* Preprint 

  Access Paper or Ask Questions

Local Knowledge Powered Conversational Agents


Oct 20, 2020
Sashank Santhanam, Wei Ping, Raul Puri, Mohammad Shoeybi, Mostofa Patwary, Bryan Catanzaro


  Access Paper or Ask Questions

BioMegatron: Larger Biomedical Domain Language Model


Oct 14, 2020
Hoo-Chang Shin, Yang Zhang, Evelina Bakhturina, Raul Puri, Mostofa Patwary, Mohammad Shoeybi, Raghav Mani

* Accepted for publication at EMNLP 2020 

  Access Paper or Ask Questions

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models


Oct 02, 2020
Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Raul Puri, Pascale Fung, Anima Anandkumar, Bryan Catanzaro

* Accepted in EMNLP 2020 main conference 

  Access Paper or Ask Questions

Large Scale Multi-Actor Generative Dialog Modeling


May 13, 2020
Alex Boyd, Raul Puri, Mohammad Shoeybi, Mostofa Patwary, Bryan Catanzaro


  Access Paper or Ask Questions

Style Example-Guided Text Generation using Generative Adversarial Transformers


Mar 02, 2020
Kuo-Hao Zeng, Mohammad Shoeybi, Ming-Yu Liu


  Access Paper or Ask Questions

Training Question Answering Models From Synthetic Data


Feb 22, 2020
Raul Puri, Ryan Spring, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro


  Access Paper or Ask Questions

Neural ODEs for Image Segmentation with Level Sets


Dec 25, 2019
Rafael Valle, Fitsum Reda, Mohammad Shoeybi, Patrick Legresley, Andrew Tao, Bryan Catanzaro


  Access Paper or Ask Questions

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism


Oct 05, 2019
Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro


  Access Paper or Ask Questions

Unsupervised Video Interpolation Using Cycle Consistency


Jun 13, 2019
Fitsum A. Reda, Deqing Sun, Aysegul Dundar, Mohammad Shoeybi, Guilin Liu, Kevin J. Shih, Andrew Tao, Jan Kautz, Bryan Catanzaro


  Access Paper or Ask Questions

Trace norm regularization and faster inference for embedded speech recognition RNNs


Feb 06, 2018
Markus Kliegl, Siddharth Goyal, Kexin Zhao, Kavya Srinet, Mohammad Shoeybi

* Our optimized inference kernels are available at: https://github.com/PaddlePaddle/farm (Note: This paper was submitted to, but rejected from, ICLR 2018. We believe it may still be of value to others. Please see the discussion here: https://openreview.net/forum?id=B1tC-LT6W

  Access Paper or Ask Questions

Deep Voice: Real-time Neural Text-to-Speech


Mar 07, 2017
Sercan O. Arik, Mike Chrzanowski, Adam Coates, Gregory Diamos, Andrew Gibiansky, Yongguo Kang, Xian Li, John Miller, Andrew Ng, Jonathan Raiman, Shubho Sengupta, Mohammad Shoeybi

* Submitted to ICML 2017 

  Access Paper or Ask Questions