Alert button
Picture for Adams Wei Yu

Adams Wei Yu

Alert button

Large Language Models Cannot Self-Correct Reasoning Yet

Oct 03, 2023
Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, Denny Zhou

Figure 1 for Large Language Models Cannot Self-Correct Reasoning Yet
Figure 2 for Large Language Models Cannot Self-Correct Reasoning Yet
Figure 3 for Large Language Models Cannot Self-Correct Reasoning Yet
Figure 4 for Large Language Models Cannot Self-Correct Reasoning Yet
Viaarxiv icon

DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining

May 24, 2023
Sang Michael Xie, Hieu Pham, Xuanyi Dong, Nan Du, Hanxiao Liu, Yifeng Lu, Percy Liang, Quoc V. Le, Tengyu Ma, Adams Wei Yu

Figure 1 for DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Figure 2 for DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Figure 3 for DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Figure 4 for DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Viaarxiv icon

DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection

Mar 15, 2022
Yingwei Li, Adams Wei Yu, Tianjian Meng, Ben Caine, Jiquan Ngiam, Daiyi Peng, Junyang Shen, Bo Wu, Yifeng Lu, Denny Zhou, Quoc V. Le, Alan Yuille, Mingxing Tan

Figure 1 for DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection
Figure 2 for DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection
Figure 3 for DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection
Figure 4 for DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection
Viaarxiv icon

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

Dec 13, 2021
Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathy Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V Le, Yonghui Wu, Zhifeng Chen, Claire Cui

Figure 1 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Figure 2 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Figure 3 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Figure 4 for GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Viaarxiv icon

Combined Scaling for Zero-shot Transfer Learning

Nov 19, 2021
Hieu Pham, Zihang Dai, Golnaz Ghiasi, Hanxiao Liu, Adams Wei Yu, Minh-Thang Luong, Mingxing Tan, Quoc V. Le

Figure 1 for Combined Scaling for Zero-shot Transfer Learning
Figure 2 for Combined Scaling for Zero-shot Transfer Learning
Figure 3 for Combined Scaling for Zero-shot Transfer Learning
Figure 4 for Combined Scaling for Zero-shot Transfer Learning
Viaarxiv icon

Towards Zero-Label Language Learning

Sep 19, 2021
Zirui Wang, Adams Wei Yu, Orhan Firat, Yuan Cao

Figure 1 for Towards Zero-Label Language Learning
Figure 2 for Towards Zero-Label Language Learning
Figure 3 for Towards Zero-Label Language Learning
Figure 4 for Towards Zero-Label Language Learning
Viaarxiv icon

Finetuned Language Models Are Zero-Shot Learners

Sep 03, 2021
Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, Quoc V. Le

Figure 1 for Finetuned Language Models Are Zero-Shot Learners
Figure 2 for Finetuned Language Models Are Zero-Shot Learners
Figure 3 for Finetuned Language Models Are Zero-Shot Learners
Figure 4 for Finetuned Language Models Are Zero-Shot Learners
Viaarxiv icon

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

Aug 24, 2021
Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao

Figure 1 for SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Figure 2 for SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Figure 3 for SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Figure 4 for SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Viaarxiv icon

Compositional Generalization via Neural-Symbolic Stack Machines

Aug 15, 2020
Xinyun Chen, Chen Liang, Adams Wei Yu, Dawn Song, Denny Zhou

Figure 1 for Compositional Generalization via Neural-Symbolic Stack Machines
Figure 2 for Compositional Generalization via Neural-Symbolic Stack Machines
Figure 3 for Compositional Generalization via Neural-Symbolic Stack Machines
Figure 4 for Compositional Generalization via Neural-Symbolic Stack Machines
Viaarxiv icon

AutoHAS: Differentiable Hyper-parameter and Architecture Search

Jun 05, 2020
Xuanyi Dong, Mingxing Tan, Adams Wei Yu, Daiyi Peng, Bogdan Gabrys, Quoc V. Le

Figure 1 for AutoHAS: Differentiable Hyper-parameter and Architecture Search
Figure 2 for AutoHAS: Differentiable Hyper-parameter and Architecture Search
Figure 3 for AutoHAS: Differentiable Hyper-parameter and Architecture Search
Figure 4 for AutoHAS: Differentiable Hyper-parameter and Architecture Search
Viaarxiv icon