Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Pathways: Asynchronous Distributed Dataflow for ML



Paul Barham , Aakanksha Chowdhery , Jeff Dean , Sanjay Ghemawat , Steven Hand , Dan Hurt , Michael Isard , Hyeontaek Lim , Ruoming Pang , Sudip Roy , Brennan Saeta , Parker Schuh , Ryan Sepassi , Laurent El Shafey , Chandramohan A. Thekkath , Yonghui Wu

* MLSys 2022 

   Access Paper or Ask Questions

Sentence-Select: Large-Scale Language Model Data Selection for Rare-Word Speech Recognition



W. Ronny Huang , Cal Peyser , Tara N. Sainath , Ruoming Pang , Trevor Strohman , Shankar Kumar


   Access Paper or Ask Questions

Co-training Transformer with Videos and Images Improves Action Recognition



Bowen Zhang , Jiahui Yu , Christopher Fifty , Wei Han , Andrew M. Dai , Ruoming Pang , Fei Sha


   Access Paper or Ask Questions

Vector-quantized Image Modeling with Improved VQGAN



Jiahui Yu , Xin Li , Jing Yu Koh , Han Zhang , Ruoming Pang , James Qin , Alexander Ku , Yuanzhong Xu , Jason Baldridge , Yonghui Wu

* Preprint 

   Access Paper or Ask Questions

BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition



Yu Zhang , Daniel S. Park , Wei Han , James Qin , Anmol Gulati , Joel Shor , Aren Jansen , Yuanzhong Xu , Yanping Huang , Shibo Wang , Zongwei Zhou , Bo Li , Min Ma , William Chan , Jiahui Yu , Yongqiang Wang , Liangliang Cao , Khe Chai Sim , Bhuvana Ramabhadran , Tara N. Sainath , Françoise Beaufays , Zhifeng Chen , Quoc V. Le , Chung-Cheng Chiu , Ruoming Pang , Yonghui Wu

* 14 pages, 7 figures, 13 tables; v2: minor corrections, reference baselines and bibliography updated 

   Access Paper or Ask Questions

W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training



Yu-An Chung , Yu Zhang , Wei Han , Chung-Cheng Chiu , James Qin , Ruoming Pang , Yonghui Wu


   Access Paper or Ask Questions

GSPMD: General and Scalable Parallelization for ML Computation Graphs



Yuanzhong Xu , HyoukJoong Lee , Dehao Chen , Blake Hechtman , Yanping Huang , Rahul Joshi , Maxim Krikun , Dmitry Lepikhin , Andy Ly , Marcello Maggioni , Ruoming Pang , Noam Shazeer , Shibo Wang , Tao Wang , Yonghui Wu , Zhifeng Chen


   Access Paper or Ask Questions

Scaling End-to-End Models for Large-Scale Multilingual ASR



Bo Li , Ruoming Pang , Tara N. Sainath , Anmol Gulati , Yu Zhang , James Qin , Parisa Haghani , W. Ronny Huang , Min Ma

* Submitted to INTERSPEECH 2021 

   Access Paper or Ask Questions

Bridging the gap between streaming and non-streaming ASR systems bydistilling ensembles of CTC and RNN-T models



Thibault Doutre , Wei Han , Chung-Cheng Chiu , Ruoming Pang , Olivier Siohan , Liangliang Cao


   Access Paper or Ask Questions

Searching for Fast Model Families on Datacenter Accelerators



Sheng Li , Mingxing Tan , Ruoming Pang , Andrew Li , Liqun Cheng , Quoc Le , Norman P. Jouppi


   Access Paper or Ask Questions

1
2
3
4
5
>>