Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Quoc V. Le

CoAtNet: Marrying Convolution and Attention for All Data Sizes


Jun 09, 2021
Zihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing Tan


  Access Paper or Ask Questions

Pay Attention to MLPs


Jun 01, 2021
Hanxiao Liu, Zihang Dai, David R. So, Quoc V. Le


  Access Paper or Ask Questions

EfficientNetV2: Smaller Models and Faster Training


Apr 01, 2021
Mingxing Tan, Quoc V. Le


  Access Paper or Ask Questions

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision


Feb 11, 2021
Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc V. Le, Yunhsuan Sung, Zhen Li, Tom Duerig


  Access Paper or Ask Questions

PyGlove: Symbolic Programming for Automated Machine Learning


Jan 21, 2021
Daiyi Peng, Xuanyi Dong, Esteban Real, Mingxing Tan, Yifeng Lu, Hanxiao Liu, Gabriel Bender, Adam Kraft, Chen Liang, Quoc V. Le

* NeurIPS 2020 Oral 

  Access Paper or Ask Questions

Evolving Reinforcement Learning Algorithms


Jan 08, 2021
John D. Co-Reyes, Yingjie Miao, Daiyi Peng, Esteban Real, Sergey Levine, Quoc V. Le, Honglak Lee, Aleksandra Faust


  Access Paper or Ask Questions

AutoDropout: Learning Dropout Patterns to Regularize Deep Networks


Jan 05, 2021
Hieu Pham, Quoc V. Le

* Accepted to AAAI 2021 

  Access Paper or Ask Questions

Pre-Training Transformers as Energy-Based Cloze Models


Dec 15, 2020
Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

* EMNLP 2020 

  Access Paper or Ask Questions

Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation


Dec 13, 2020
Golnaz Ghiasi, Yin Cui, Aravind Srinivas, Rui Qian, Tsung-Yi Lin, Ekin D. Cubuk, Quoc V. Le, Barret Zoph


  Access Paper or Ask Questions

Towards Domain-Agnostic Contrastive Learning


Nov 09, 2020
Vikas Verma, Minh-Thang Luong, Kenji Kawaguchi, Hieu Pham, Quoc V. Le


  Access Paper or Ask Questions

Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition


Oct 20, 2020
Yu Zhang, James Qin, Daniel S. Park, Wei Han, Chung-Cheng Chiu, Ruoming Pang, Quoc V. Le, Yonghui Wu

* 11 pages, 3 figures, 5 tables. Submitted to NeurIPS SAS 2020 Workshop 

  Access Paper or Ask Questions

Smooth Adversarial Training


Jun 25, 2020
Cihang Xie, Mingxing Tan, Boqing Gong, Alan Yuille, Quoc V. Le

* tech report 

  Access Paper or Ask Questions

Rethinking Pre-training and Self-training


Jun 11, 2020
Barret Zoph, Golnaz Ghiasi, Tsung-Yi Lin, Yin Cui, Hanxiao Liu, Ekin D. Cubuk, Quoc V. Le


  Access Paper or Ask Questions

AutoHAS: Differentiable Hyper-parameter and Architecture Search


Jun 05, 2020
Xuanyi Dong, Mingxing Tan, Adams Wei Yu, Daiyi Peng, Bogdan Gabrys, Quoc V. Le


  Access Paper or Ask Questions

Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing


Jun 05, 2020
Zihang Dai, Guokun Lai, Yiming Yang, Quoc V. Le


  Access Paper or Ask Questions

Improved Noisy Student Training for Automatic Speech Recognition


May 19, 2020
Daniel S. Park, Yu Zhang, Ye Jia, Wei Han, Chung-Cheng Chiu, Bo Li, Yonghui Wu, Quoc V. Le

* 5 pages, 5 figures, 4 tables. Submitted to Interspeech 2020 

  Access Paper or Ask Questions

Evolving Normalization-Activation Layers


Apr 28, 2020
Hanxiao Liu, Andrew Brock, Karen Simonyan, Quoc V. Le


  Access Paper or Ask Questions

Meta Pseudo Labels


Apr 23, 2020
Hieu Pham, Qizhe Xie, Zihang Dai, Quoc V. Le

* Preprint 

  Access Paper or Ask Questions

Chip Placement with Deep Reinforcement Learning


Apr 22, 2020
Azalia Mirhoseini, Anna Goldie, Mustafa Yazgan, Joe Jiang, Ebrahim Songhori, Shen Wang, Young-Joon Lee, Eric Johnson, Omkar Pathak, Sungmin Bae, Azade Nazi, Jiwoo Pak, Andy Tong, Kavya Srinivasa, William Hang, Emre Tuncer, Anand Babu, Quoc V. Le, James Laudon, Richard Ho, Roger Carpenter, Jeff Dean


  Access Paper or Ask Questions

Improving 3D Object Detection through Progressive Population Based Augmentation


Apr 02, 2020
Shuyang Cheng, Zhaoqi Leng, Ekin Dogus Cubuk, Barret Zoph, Chunyan Bai, Jiquan Ngiam, Yang Song, Benjamin Caine, Vijay Vasudevan, Congcong Li, Quoc V. Le, Jonathon Shlens, Dragomir Anguelov


  Access Paper or Ask Questions

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators


Mar 23, 2020
Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

* ICLR 2020 

  Access Paper or Ask Questions

AutoML-Zero: Evolving Machine Learning Algorithms From Scratch


Mar 06, 2020
Esteban Real, Chen Liang, David R. So, Quoc V. Le


  Access Paper or Ask Questions

Towards a Human-like Open-Domain Chatbot


Feb 27, 2020
Daniel Adiwardana, Minh-Thang Luong, David R. So, Jamie Hall, Noah Fiedel, Romal Thoppilan, Zi Yang, Apoorv Kulshreshtha, Gaurav Nemade, Yifeng Lu, Quoc V. Le

* 38 pages, 12 figures 

  Access Paper or Ask Questions

SpecAugment on Large Scale Datasets


Dec 11, 2019
Daniel S. Park, Yu Zhang, Chung-Cheng Chiu, Youzheng Chen, Bo Li, William Chan, Quoc V. Le, Yonghui Wu

* 5 pages, 3 tables; submitted to ICASSP 2020 

  Access Paper or Ask Questions

SpineNet: Learning Scale-Permuted Backbone for Recognition and Localization


Dec 10, 2019
Xianzhi Du, Tsung-Yi Lin, Pengchong Jin, Golnaz Ghiasi, Mingxing Tan, Yin Cui, Quoc V. Le, Xiaodan Song


  Access Paper or Ask Questions