Alert button
Picture for Alec Radford

Alec Radford

Alert button

Robust Speech Recognition via Large-Scale Weak Supervision

Dec 06, 2022
Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, Ilya Sutskever

Figure 1 for Robust Speech Recognition via Large-Scale Weak Supervision
Figure 2 for Robust Speech Recognition via Large-Scale Weak Supervision
Figure 3 for Robust Speech Recognition via Large-Scale Weak Supervision
Figure 4 for Robust Speech Recognition via Large-Scale Weak Supervision
Viaarxiv icon

Text and Code Embeddings by Contrastive Pre-Training

Jan 24, 2022
Arvind Neelakantan, Tao Xu, Raul Puri, Alec Radford, Jesse Michael Han, Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, Johannes Heidecke, Pranav Shyam, Boris Power, Tyna Eloundou Nekoul, Girish Sastry, Gretchen Krueger, David Schnurr, Felipe Petroski Such, Kenny Hsu, Madeleine Thompson, Tabarak Khan, Toki Sherbakov, Joanne Jang, Peter Welinder, Lilian Weng

Figure 1 for Text and Code Embeddings by Contrastive Pre-Training
Figure 2 for Text and Code Embeddings by Contrastive Pre-Training
Figure 3 for Text and Code Embeddings by Contrastive Pre-Training
Figure 4 for Text and Code Embeddings by Contrastive Pre-Training
Viaarxiv icon

Unsupervised Neural Machine Translation with Generative Language Models Only

Oct 11, 2021
Jesse Michael Han, Igor Babuschkin, Harrison Edwards, Arvind Neelakantan, Tao Xu, Stanislas Polu, Alex Ray, Pranav Shyam, Aditya Ramesh, Alec Radford, Ilya Sutskever

Figure 1 for Unsupervised Neural Machine Translation with Generative Language Models Only
Figure 2 for Unsupervised Neural Machine Translation with Generative Language Models Only
Figure 3 for Unsupervised Neural Machine Translation with Generative Language Models Only
Figure 4 for Unsupervised Neural Machine Translation with Generative Language Models Only
Viaarxiv icon

Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications

Aug 05, 2021
Sandhini Agarwal, Gretchen Krueger, Jack Clark, Alec Radford, Jong Wook Kim, Miles Brundage

Figure 1 for Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications
Figure 2 for Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications
Figure 3 for Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications
Figure 4 for Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications
Viaarxiv icon

Evaluating Large Language Models Trained on Code

Jul 14, 2021
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, Wojciech Zaremba

Figure 1 for Evaluating Large Language Models Trained on Code
Figure 2 for Evaluating Large Language Models Trained on Code
Figure 3 for Evaluating Large Language Models Trained on Code
Figure 4 for Evaluating Large Language Models Trained on Code
Viaarxiv icon

Zero-Shot Text-to-Image Generation

Feb 26, 2021
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, Ilya Sutskever

Figure 1 for Zero-Shot Text-to-Image Generation
Figure 2 for Zero-Shot Text-to-Image Generation
Figure 3 for Zero-Shot Text-to-Image Generation
Figure 4 for Zero-Shot Text-to-Image Generation
Viaarxiv icon

Learning Transferable Visual Models From Natural Language Supervision

Feb 26, 2021
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, Ilya Sutskever

Figure 1 for Learning Transferable Visual Models From Natural Language Supervision
Figure 2 for Learning Transferable Visual Models From Natural Language Supervision
Figure 3 for Learning Transferable Visual Models From Natural Language Supervision
Figure 4 for Learning Transferable Visual Models From Natural Language Supervision
Viaarxiv icon

Scaling Laws for Autoregressive Generative Modeling

Nov 06, 2020
Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish

Figure 1 for Scaling Laws for Autoregressive Generative Modeling
Figure 2 for Scaling Laws for Autoregressive Generative Modeling
Figure 3 for Scaling Laws for Autoregressive Generative Modeling
Figure 4 for Scaling Laws for Autoregressive Generative Modeling
Viaarxiv icon