Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

PaLM: Scaling Language Modeling with Pathways



Aakanksha Chowdhery , Sharan Narang , Jacob Devlin , Maarten Bosma , Gaurav Mishra , Adam Roberts , Paul Barham , Hyung Won Chung , Charles Sutton , Sebastian Gehrmann , Parker Schuh , Kensen Shi , Sasha Tsvyashchenko , Joshua Maynez , Abhishek Rao , Parker Barnes , Yi Tay , Noam Shazeer , Vinodkumar Prabhakaran , Emily Reif , Nan Du , Ben Hutchinson , Reiner Pope , James Bradbury , Jacob Austin , Michael Isard , Guy Gur-Ari , Pengcheng Yin , Toju Duke , Anselm Levskaya , Sanjay Ghemawat , Sunipa Dev , Henryk Michalewski , Xavier Garcia , Vedant Misra , Kevin Robinson , Liam Fedus , Denny Zhou , Daphne Ippolito , David Luan , Hyeontaek Lim , Barret Zoph , Alexander Spiridonov , Ryan Sepassi , David Dohan , Shivani Agrawal , Mark Omernick , Andrew M. Dai , Thanumalayan Sankaranarayana Pillai , Marie Pellat , Aitor Lewkowycz , Erica Moreira , Rewon Child , Oleksandr Polozov , Katherine Lee , Zongwei Zhou , Xuezhi Wang , Brennan Saeta , Mark Diaz , Orhan Firat , Michele Catasta , Jason Wei , Kathy Meier-Hellstern , Douglas Eck , Jeff Dean , Slav Petrov , Noah Fiedel


   Access Paper or Ask Questions

Pathways: Asynchronous Distributed Dataflow for ML



Paul Barham , Aakanksha Chowdhery , Jeff Dean , Sanjay Ghemawat , Steven Hand , Dan Hurt , Michael Isard , Hyeontaek Lim , Ruoming Pang , Sudip Roy , Brennan Saeta , Parker Schuh , Ryan Sepassi , Laurent El Shafey , Chandramohan A. Thekkath , Yonghui Wu

* MLSys 2022 

   Access Paper or Ask Questions

Sequential Routing Framework: Fully Capsule Network-based Speech Recognition



Kyungmin Lee , Hyunwhan Joe , Hyeontaek Lim , Kwangyoun Kim , Sungsoo Kim , Chang Woo Han , Hong-Gee Kim

* 40 pages, 7 figures (totally 10 figures), submitted to Computer Speech and Language (Only line numbers were removed from the submitted version) 

   Access Paper or Ask Questions

Scaling Video Analytics on Constrained Edge Nodes



Christopher Canel , Thomas Kim , Giulio Zhou , Conglong Li , Hyeontaek Lim , David G. Andersen , Michael Kaminsky , Subramanya R. Dulloor

* This paper is an extended version of a paper with the same title published in the 2nd SysML Conference, SysML '19 (Canel et. al., 2019) 

   Access Paper or Ask Questions

3LC: Lightweight and Effective Traffic Compression for Distributed Machine Learning



Hyeontaek Lim , David G. Andersen , Michael Kaminsky


   Access Paper or Ask Questions