Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox
Picture for Yonghui Wu

Yonghui Wu

Scaling Autoregressive Models for Content-Rich Text-to-Image Generation



Jiahui Yu , Yuanzhong Xu , Jing Yu Koh , Thang Luong , Gunjan Baid , Zirui Wang , Vijay Vasudevan , Alexander Ku , Yinfei Yang , Burcu Karagol Ayan , Ben Hutchinson , Wei Han , Zarana Parekh , Xin Li , Han Zhang , Jason Baldridge , Yonghui Wu

Figure 1 for Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
Figure 2 for Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
Figure 3 for Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
Figure 4 for Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
* Preprint 
   Access Paper or Ask Questions

Building Machine Translation Systems for the Next Thousand Languages



Ankur Bapna , Isaac Caswell , Julia Kreutzer , Orhan Firat , Daan van Esch , Aditya Siddhant , Mengmeng Niu , Pallavi Baljekar , Xavier Garcia , Wolfgang Macherey , Theresa Breiner , Vera Axelrod , Jason Riesa , Yuan Cao , Mia Xu Chen , Klaus Macherey , Maxim Krikun , Pidong Wang , Alexander Gutkin , Apurva Shah , Yanping Huang , Zhifeng Chen , Yonghui Wu , Macduff Hughes

Figure 1 for Building Machine Translation Systems for the Next Thousand Languages
Figure 2 for Building Machine Translation Systems for the Next Thousand Languages
Figure 3 for Building Machine Translation Systems for the Next Thousand Languages
Figure 4 for Building Machine Translation Systems for the Next Thousand Languages
* V2: updated with some details from 24-language Google Translate launch in May 2022 
   Access Paper or Ask Questions

CoCa: Contrastive Captioners are Image-Text Foundation Models



Jiahui Yu , Zirui Wang , Vijay Vasudevan , Legg Yeung , Mojtaba Seyedhosseini , Yonghui Wu

Figure 1 for CoCa: Contrastive Captioners are Image-Text Foundation Models
Figure 2 for CoCa: Contrastive Captioners are Image-Text Foundation Models
Figure 3 for CoCa: Contrastive Captioners are Image-Text Foundation Models
Figure 4 for CoCa: Contrastive Captioners are Image-Text Foundation Models
* Preprint 
   Access Paper or Ask Questions

Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue



Raghav Gupta , Harrison Lee , Jeffrey Zhao , Abhinav Rastogi , Yuan Cao , Yonghui Wu

Figure 1 for Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Figure 2 for Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Figure 3 for Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Figure 4 for Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
* To appear at NAACL 2022 
   Access Paper or Ask Questions

Pathways: Asynchronous Distributed Dataflow for ML



Paul Barham , Aakanksha Chowdhery , Jeff Dean , Sanjay Ghemawat , Steven Hand , Dan Hurt , Michael Isard , Hyeontaek Lim , Ruoming Pang , Sudip Roy , Brennan Saeta , Parker Schuh , Ryan Sepassi , Laurent El Shafey , Chandramohan A. Thekkath , Yonghui Wu

Figure 1 for Pathways: Asynchronous Distributed Dataflow for ML
Figure 2 for Pathways: Asynchronous Distributed Dataflow for ML
Figure 3 for Pathways: Asynchronous Distributed Dataflow for ML
Figure 4 for Pathways: Asynchronous Distributed Dataflow for ML
* MLSys 2022 
   Access Paper or Ask Questions

Self-supervised Learning with Random-projection Quantizer for Speech Recognition



Chung-Cheng Chiu , James Qin , Yu Zhang , Jiahui Yu , Yonghui Wu

Figure 1 for Self-supervised Learning with Random-projection Quantizer for Speech Recognition
Figure 2 for Self-supervised Learning with Random-projection Quantizer for Speech Recognition
Figure 3 for Self-supervised Learning with Random-projection Quantizer for Speech Recognition
Figure 4 for Self-supervised Learning with Random-projection Quantizer for Speech Recognition

   Access Paper or Ask Questions

Description-Driven Task-Oriented Dialog Modeling



Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu


   Access Paper or Ask Questions

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts



Nan Du , Yanping Huang , Andrew M. Dai , Simon Tong , Dmitry Lepikhin , Yuanzhong Xu , Maxim Krikun , Yanqi Zhou , Adams Wei Yu , Orhan Firat , Barret Zoph , Liam Fedus , Maarten Bosma , Zongwei Zhou , Tao Wang , Yu Emma Wang , Kellie Webster , Marie Pellat , Kevin Robinson , Kathy Meier-Hellstern , Toju Duke , Lucas Dixon , Kun Zhang , Quoc V Le , Yonghui Wu , Zhifeng Chen , Claire Cui

Figure 1 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Figure 2 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Figure 3 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Figure 4 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

   Access Paper or Ask Questions

SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems



Harrison Lee , Raghav Gupta , Abhinav Rastogi , Yuan Cao , Bin Zhang , Yonghui Wu

Figure 1 for SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
Figure 2 for SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
Figure 3 for SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
Figure 4 for SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems

   Access Paper or Ask Questions

Vector-quantized Image Modeling with Improved VQGAN



Jiahui Yu , Xin Li , Jing Yu Koh , Han Zhang , Ruoming Pang , James Qin , Alexander Ku , Yuanzhong Xu , Jason Baldridge , Yonghui Wu

Figure 1 for Vector-quantized Image Modeling with Improved VQGAN
Figure 2 for Vector-quantized Image Modeling with Improved VQGAN
Figure 3 for Vector-quantized Image Modeling with Improved VQGAN
Figure 4 for Vector-quantized Image Modeling with Improved VQGAN
* Preprint 
   Access Paper or Ask Questions
1
2
3
4
5
6
7
>>