Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Emergent Abilities of Large Language Models



Jason Wei , Yi Tay , Rishi Bommasani , Colin Raffel , Barret Zoph , Sebastian Borgeaud , Dani Yogatama , Maarten Bosma , Denny Zhou , Donald Metzler , Ed H. Chi , Tatsunori Hashimoto , Oriol Vinyals , Percy Liang , Jeff Dean , William Fedus


   Access Paper or Ask Questions

An Evolutionary Approach to Dynamic Introduction of Tasks in Large-scale Multitask Learning Systems



Andrea Gesmundo , Jeff Dean


   Access Paper or Ask Questions

muNet: Evolving Pretrained Deep Neural Networks into Scalable Auto-tuning Multitask Systems



Andrea Gesmundo , Jeff Dean


   Access Paper or Ask Questions

PaLM: Scaling Language Modeling with Pathways



Aakanksha Chowdhery , Sharan Narang , Jacob Devlin , Maarten Bosma , Gaurav Mishra , Adam Roberts , Paul Barham , Hyung Won Chung , Charles Sutton , Sebastian Gehrmann , Parker Schuh , Kensen Shi , Sasha Tsvyashchenko , Joshua Maynez , Abhishek Rao , Parker Barnes , Yi Tay , Noam Shazeer , Vinodkumar Prabhakaran , Emily Reif , Nan Du , Ben Hutchinson , Reiner Pope , James Bradbury , Jacob Austin , Michael Isard , Guy Gur-Ari , Pengcheng Yin , Toju Duke , Anselm Levskaya , Sanjay Ghemawat , Sunipa Dev , Henryk Michalewski , Xavier Garcia , Vedant Misra , Kevin Robinson , Liam Fedus , Denny Zhou , Daphne Ippolito , David Luan , Hyeontaek Lim , Barret Zoph , Alexander Spiridonov , Ryan Sepassi , David Dohan , Shivani Agrawal , Mark Omernick , Andrew M. Dai , Thanumalayan Sankaranarayana Pillai , Marie Pellat , Aitor Lewkowycz , Erica Moreira , Rewon Child , Oleksandr Polozov , Katherine Lee , Zongwei Zhou , Xuezhi Wang , Brennan Saeta , Mark Diaz , Orhan Firat , Michele Catasta , Jason Wei , Kathy Meier-Hellstern , Douglas Eck , Jeff Dean , Slav Petrov , Noah Fiedel


   Access Paper or Ask Questions

The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink



David Patterson , Joseph Gonzalez , Urs Hölzle , Quoc Le , Chen Liang , Lluis-Miquel Munguia , Daniel Rothchild , David So , Maud Texier , Jeff Dean


   Access Paper or Ask Questions

Pathways: Asynchronous Distributed Dataflow for ML



Paul Barham , Aakanksha Chowdhery , Jeff Dean , Sanjay Ghemawat , Steven Hand , Dan Hurt , Michael Isard , Hyeontaek Lim , Ruoming Pang , Sudip Roy , Brennan Saeta , Parker Schuh , Ryan Sepassi , Laurent El Shafey , Chandramohan A. Thekkath , Yonghui Wu

* MLSys 2022 

   Access Paper or Ask Questions

Designing Effective Sparse Expert Models



Barret Zoph , Irwan Bello , Sameer Kumar , Nan Du , Yanping Huang , Jeff Dean , Noam Shazeer , William Fedus

* 25 pages main text, 39 pages overall 

   Access Paper or Ask Questions

1
2
3
>>