Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Heewoo Jun

Evaluating Large Language Models Trained on Code


Jul 14, 2021
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, Wojciech Zaremba

* corrected typos, added references, added authors, added acknowledgements 

  Access Paper or Ask Questions

Scaling Laws for Autoregressive Generative Modeling


Nov 06, 2020
Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish

* 20+17 pages, 33 figures; added appendix with additional language results 

  Access Paper or Ask Questions

Jukebox: A Generative Model for Music


Apr 30, 2020
Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, Ilya Sutskever


  Access Paper or Ask Questions

Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks


Nov 06, 2018
Sercan O. Arik, Heewoo Jun, Gregory Diamos


  Access Paper or Ask Questions

Language Modeling at Scale


Oct 23, 2018
Mostofa Patwary, Milind Chabbi, Heewoo Jun, Jiaji Huang, Gregory Diamos, Kenneth Church


  Access Paper or Ask Questions

Deep Learning Scaling is Predictable, Empirically


Dec 01, 2017
Joel Hestness, Sharan Narang, Newsha Ardalani, Gregory Diamos, Heewoo Jun, Hassan Kianinejad, Md. Mostofa Ali Patwary, Yang Yang, Yanqi Zhou

* 19 pages, 11 figures 

  Access Paper or Ask Questions

Robust Speech Recognition Using Generative Adversarial Networks


Nov 05, 2017
Anuroop Sriram, Heewoo Jun, Yashesh Gaur, Sanjeev Satheesh


  Access Paper or Ask Questions

Cold Fusion: Training Seq2Seq Models Together with Language Models


Aug 21, 2017
Anuroop Sriram, Heewoo Jun, Sanjeev Satheesh, Adam Coates


  Access Paper or Ask Questions

Reducing Bias in Production Speech Models


May 11, 2017
Eric Battenberg, Rewon Child, Adam Coates, Christopher Fougner, Yashesh Gaur, Jiaji Huang, Heewoo Jun, Ajay Kannan, Markus Kliegl, Atul Kumar, Hairong Liu, Vinay Rao, Sanjeev Satheesh, David Seetapun, Anuroop Sriram, Zhenyao Zhu


  Access Paper or Ask Questions