Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Heewoo Jun

Scaling Laws for Autoregressive Generative Modeling


Nov 06, 2020
Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish

* 20+17 pages, 33 figures; added appendix with additional language results 

  Access Paper or Ask Questions

Jukebox: A Generative Model for Music


Apr 30, 2020
Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, Ilya Sutskever


  Access Paper or Ask Questions

Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks


Nov 06, 2018
Sercan O. Arik, Heewoo Jun, Gregory Diamos


  Access Paper or Ask Questions

Language Modeling at Scale


Oct 23, 2018
Mostofa Patwary, Milind Chabbi, Heewoo Jun, Jiaji Huang, Gregory Diamos, Kenneth Church


  Access Paper or Ask Questions

Deep Learning Scaling is Predictable, Empirically


Dec 01, 2017
Joel Hestness, Sharan Narang, Newsha Ardalani, Gregory Diamos, Heewoo Jun, Hassan Kianinejad, Md. Mostofa Ali Patwary, Yang Yang, Yanqi Zhou

* 19 pages, 11 figures 

  Access Paper or Ask Questions

Robust Speech Recognition Using Generative Adversarial Networks


Nov 05, 2017
Anuroop Sriram, Heewoo Jun, Yashesh Gaur, Sanjeev Satheesh


  Access Paper or Ask Questions

Cold Fusion: Training Seq2Seq Models Together with Language Models


Aug 21, 2017
Anuroop Sriram, Heewoo Jun, Sanjeev Satheesh, Adam Coates


  Access Paper or Ask Questions

Reducing Bias in Production Speech Models


May 11, 2017
Eric Battenberg, Rewon Child, Adam Coates, Christopher Fougner, Yashesh Gaur, Jiaji Huang, Heewoo Jun, Ajay Kannan, Markus Kliegl, Atul Kumar, Hairong Liu, Vinay Rao, Sanjeev Satheesh, David Seetapun, Anuroop Sriram, Zhenyao Zhu


  Access Paper or Ask Questions