Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox
Picture for Charles Sutton

Charles Sutton

PaLM: Scaling Language Modeling with Pathways



Aakanksha Chowdhery , Sharan Narang , Jacob Devlin , Maarten Bosma , Gaurav Mishra , Adam Roberts , Paul Barham , Hyung Won Chung , Charles Sutton , Sebastian Gehrmann , Parker Schuh , Kensen Shi , Sasha Tsvyashchenko , Joshua Maynez , Abhishek Rao , Parker Barnes , Yi Tay , Noam Shazeer , Vinodkumar Prabhakaran , Emily Reif , Nan Du , Ben Hutchinson , Reiner Pope , James Bradbury , Jacob Austin , Michael Isard , Guy Gur-Ari , Pengcheng Yin , Toju Duke , Anselm Levskaya , Sanjay Ghemawat , Sunipa Dev , Henryk Michalewski , Xavier Garcia , Vedant Misra , Kevin Robinson , Liam Fedus , Denny Zhou , Daphne Ippolito , David Luan , Hyeontaek Lim , Barret Zoph , Alexander Spiridonov , Ryan Sepassi , David Dohan , Shivani Agrawal , Mark Omernick , Andrew M. Dai , Thanumalayan Sankaranarayana Pillai , Marie Pellat , Aitor Lewkowycz , Erica Moreira , Rewon Child , Oleksandr Polozov , Katherine Lee , Zongwei Zhou , Xuezhi Wang , Brennan Saeta , Mark Diaz , Orhan Firat , Michele Catasta , Jason Wei , Kathy Meier-Hellstern , Douglas Eck , Jeff Dean , Slav Petrov , Noah Fiedel

Figure 1 for PaLM: Scaling Language Modeling with Pathways
Figure 2 for PaLM: Scaling Language Modeling with Pathways
Figure 3 for PaLM: Scaling Language Modeling with Pathways
Figure 4 for PaLM: Scaling Language Modeling with Pathways

   Access Paper or Ask Questions

Compositional Generalization and Decomposition in Neural Program Synthesis



Kensen Shi , Joey Hong , Manzil Zaheer , Pengcheng Yin , Charles Sutton

Figure 1 for Compositional Generalization and Decomposition in Neural Program Synthesis
Figure 2 for Compositional Generalization and Decomposition in Neural Program Synthesis
Figure 3 for Compositional Generalization and Decomposition in Neural Program Synthesis
Figure 4 for Compositional Generalization and Decomposition in Neural Program Synthesis
* Published at the Deep Learning for Code (DL4C) Workshop at ICLR 2022 
   Access Paper or Ask Questions

CrossBeam: Learning to Search in Bottom-Up Program Synthesis



Kensen Shi , Hanjun Dai , Kevin Ellis , Charles Sutton

Figure 1 for CrossBeam: Learning to Search in Bottom-Up Program Synthesis
Figure 2 for CrossBeam: Learning to Search in Bottom-Up Program Synthesis
Figure 3 for CrossBeam: Learning to Search in Bottom-Up Program Synthesis
Figure 4 for CrossBeam: Learning to Search in Bottom-Up Program Synthesis
* Published at ICLR 2022 
   Access Paper or Ask Questions

Show Your Work: Scratchpads for Intermediate Computation with Language Models



Maxwell Nye , Anders Johan Andreassen , Guy Gur-Ari , Henryk Michalewski , Jacob Austin , David Bieber , David Dohan , Aitor Lewkowycz , Maarten Bosma , David Luan , Charles Sutton , Augustus Odena

Figure 1 for Show Your Work: Scratchpads for Intermediate Computation with Language Models
Figure 2 for Show Your Work: Scratchpads for Intermediate Computation with Language Models
Figure 3 for Show Your Work: Scratchpads for Intermediate Computation with Language Models
Figure 4 for Show Your Work: Scratchpads for Intermediate Computation with Language Models

   Access Paper or Ask Questions

Program Synthesis with Large Language Models



Jacob Austin , Augustus Odena , Maxwell Nye , Maarten Bosma , Henryk Michalewski , David Dohan , Ellen Jiang , Carrie Cai , Michael Terry , Quoc Le , Charles Sutton

Figure 1 for Program Synthesis with Large Language Models
Figure 2 for Program Synthesis with Large Language Models
Figure 3 for Program Synthesis with Large Language Models
Figure 4 for Program Synthesis with Large Language Models
* Jacob and Augustus contributed equally 
   Access Paper or Ask Questions

SpreadsheetCoder: Formula Prediction from Semi-structured Context



Xinyun Chen , Petros Maniatis , Rishabh Singh , Charles Sutton , Hanjun Dai , Max Lin , Denny Zhou

Figure 1 for SpreadsheetCoder: Formula Prediction from Semi-structured Context
Figure 2 for SpreadsheetCoder: Formula Prediction from Semi-structured Context
Figure 3 for SpreadsheetCoder: Formula Prediction from Semi-structured Context
Figure 4 for SpreadsheetCoder: Formula Prediction from Semi-structured Context
* Published in ICML 2021 
   Access Paper or Ask Questions

Latent Programmer: Discrete Latent Codes for Program Synthesis



Joey Hong , David Dohan , Rishabh Singh , Charles Sutton , Manzil Zaheer

Figure 1 for Latent Programmer: Discrete Latent Codes for Program Synthesis
Figure 2 for Latent Programmer: Discrete Latent Codes for Program Synthesis
Figure 3 for Latent Programmer: Discrete Latent Codes for Program Synthesis
Figure 4 for Latent Programmer: Discrete Latent Codes for Program Synthesis
* 15 pages, 9 figures 
   Access Paper or Ask Questions

Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration



Hanjun Dai , Rishabh Singh , Bo Dai , Charles Sutton , Dale Schuurmans

Figure 1 for Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration
Figure 2 for Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration
Figure 3 for Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration
Figure 4 for Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration
* NeurIPS 2020 
   Access Paper or Ask Questions

Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks



David Bieber , Charles Sutton , Hugo Larochelle , Daniel Tarlow

Figure 1 for Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks
Figure 2 for Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks
Figure 3 for Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks
Figure 4 for Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks
* Accepted at NeurIPS 2020 
   Access Paper or Ask Questions
1
2
3
4
5
>>