Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Mohammad Shoeybi

Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases

Dec 15, 2021
Shrimai Prabhumoye, Rafal Kocielnik, Mohammad Shoeybi, Anima Anandkumar, Bryan Catanzaro

  Access Paper or Ask Questions

Long-Short Transformer: Efficient Transformers for Language and Vision

Jul 27, 2021
Chen Zhu, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Anima Anandkumar, Bryan Catanzaro

  Access Paper or Ask Questions

Efficient Large-Scale Language Model Training on GPU Clusters

Apr 09, 2021
Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

  Access Paper or Ask Questions

End-to-End Training of Neural Retrievers for Open-Domain Question Answering

Jan 02, 2021
Devendra Singh Sachan, Mostofa Patwary, Mohammad Shoeybi, Neel Kant, Wei Ping, William L Hamilton, Bryan Catanzaro

* Preprint 

  Access Paper or Ask Questions

Local Knowledge Powered Conversational Agents

Oct 20, 2020
Sashank Santhanam, Wei Ping, Raul Puri, Mohammad Shoeybi, Mostofa Patwary, Bryan Catanzaro

  Access Paper or Ask Questions

BioMegatron: Larger Biomedical Domain Language Model

Oct 14, 2020
Hoo-Chang Shin, Yang Zhang, Evelina Bakhturina, Raul Puri, Mostofa Patwary, Mohammad Shoeybi, Raghav Mani

* Accepted for publication at EMNLP 2020 

  Access Paper or Ask Questions

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

Oct 02, 2020
Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Raul Puri, Pascale Fung, Anima Anandkumar, Bryan Catanzaro

* Accepted in EMNLP 2020 main conference 

  Access Paper or Ask Questions

Large Scale Multi-Actor Generative Dialog Modeling

May 13, 2020
Alex Boyd, Raul Puri, Mohammad Shoeybi, Mostofa Patwary, Bryan Catanzaro

  Access Paper or Ask Questions

Style Example-Guided Text Generation using Generative Adversarial Transformers

Mar 02, 2020
Kuo-Hao Zeng, Mohammad Shoeybi, Ming-Yu Liu

  Access Paper or Ask Questions

Training Question Answering Models From Synthetic Data

Feb 22, 2020
Raul Puri, Ryan Spring, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro

  Access Paper or Ask Questions

Neural ODEs for Image Segmentation with Level Sets

Dec 25, 2019
Rafael Valle, Fitsum Reda, Mohammad Shoeybi, Patrick Legresley, Andrew Tao, Bryan Catanzaro

  Access Paper or Ask Questions

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Oct 05, 2019
Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

  Access Paper or Ask Questions

Unsupervised Video Interpolation Using Cycle Consistency

Jun 13, 2019
Fitsum A. Reda, Deqing Sun, Aysegul Dundar, Mohammad Shoeybi, Guilin Liu, Kevin J. Shih, Andrew Tao, Jan Kautz, Bryan Catanzaro

  Access Paper or Ask Questions

Trace norm regularization and faster inference for embedded speech recognition RNNs

Feb 06, 2018
Markus Kliegl, Siddharth Goyal, Kexin Zhao, Kavya Srinet, Mohammad Shoeybi

* Our optimized inference kernels are available at: (Note: This paper was submitted to, but rejected from, ICLR 2018. We believe it may still be of value to others. Please see the discussion here:

  Access Paper or Ask Questions

Deep Voice: Real-time Neural Text-to-Speech

Mar 07, 2017
Sercan O. Arik, Mike Chrzanowski, Adam Coates, Gregory Diamos, Andrew Gibiansky, Yongguo Kang, Xian Li, John Miller, Andrew Ng, Jonathan Raiman, Shubho Sengupta, Mohammad Shoeybi

* Submitted to ICML 2017 

  Access Paper or Ask Questions