Alert button
Picture for Jasper Snoek

Jasper Snoek

Alert button

Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models

Dec 22, 2023
Avi Singh, John D. Co-Reyes, Rishabh Agarwal, Ankesh Anand, Piyush Patil, Xavier Garcia, Peter J. Liu, James Harrison, Jaehoon Lee, Kelvin Xu, Aaron Parisi, Abhishek Kumar, Alex Alemi, Alex Rizkowsky, Azade Nova, Ben Adlam, Bernd Bohnet, Gamaleldin Elsayed, Hanie Sedghi, Igor Mordatch, Isabelle Simpson, Izzeddin Gur, Jasper Snoek, Jeffrey Pennington, Jiri Hron, Kathleen Kenealy, Kevin Swersky, Kshiteej Mahajan, Laura Culp, Lechao Xiao, Maxwell L. Bileschi, Noah Constant, Roman Novak, Rosanne Liu, Tris Warkentin, Yundi Qian, Yamini Bansal, Ethan Dyer, Behnam Neyshabur, Jascha Sohl-Dickstein, Noah Fiedel

Figure 1 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Figure 2 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Figure 3 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Figure 4 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Viaarxiv icon

Kernel Regression with Infinite-Width Neural Networks on Millions of Examples

Mar 09, 2023
Ben Adlam, Jaehoon Lee, Shreyas Padhy, Zachary Nado, Jasper Snoek

Figure 1 for Kernel Regression with Infinite-Width Neural Networks on Millions of Examples
Figure 2 for Kernel Regression with Infinite-Width Neural Networks on Millions of Examples
Figure 3 for Kernel Regression with Infinite-Width Neural Networks on Millions of Examples
Figure 4 for Kernel Regression with Infinite-Width Neural Networks on Millions of Examples
Viaarxiv icon

Plex: Towards Reliability using Pretrained Large Model Extensions

Jul 15, 2022
Dustin Tran, Jeremiah Liu, Michael W. Dusenberry, Du Phan, Mark Collier, Jie Ren, Kehang Han, Zi Wang, Zelda Mariet, Huiyi Hu, Neil Band, Tim G. J. Rudner, Karan Singhal, Zachary Nado, Joost van Amersfoort, Andreas Kirsch, Rodolphe Jenatton, Nithum Thain, Honglin Yuan, Kelly Buchanan, Kevin Murphy, D. Sculley, Yarin Gal, Zoubin Ghahramani, Jasper Snoek, Balaji Lakshminarayanan

Figure 1 for Plex: Towards Reliability using Pretrained Large Model Extensions
Figure 2 for Plex: Towards Reliability using Pretrained Large Model Extensions
Figure 3 for Plex: Towards Reliability using Pretrained Large Model Extensions
Figure 4 for Plex: Towards Reliability using Pretrained Large Model Extensions
Viaarxiv icon

Pre-training helps Bayesian optimization too

Jul 07, 2022
Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zachary Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

Figure 1 for Pre-training helps Bayesian optimization too
Figure 2 for Pre-training helps Bayesian optimization too
Figure 3 for Pre-training helps Bayesian optimization too
Figure 4 for Pre-training helps Bayesian optimization too
Viaarxiv icon

A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness

May 01, 2022
Jeremiah Zhe Liu, Shreyas Padhy, Jie Ren, Zi Lin, Yeming Wen, Ghassen Jerfel, Zack Nado, Jasper Snoek, Dustin Tran, Balaji Lakshminarayanan

Figure 1 for A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness
Figure 2 for A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness
Figure 3 for A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness
Figure 4 for A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness
Viaarxiv icon

Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach

Dec 16, 2021
Setareh Ariafar, Justin Gilmer, Zachary Nado, Jasper Snoek, Rodolphe Jenatton, George E. Dahl

Figure 1 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Figure 2 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Figure 3 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Figure 4 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Viaarxiv icon

Sparse MoEs meet Efficient Ensembles

Oct 07, 2021
James Urquhart Allingham, Florian Wenzel, Zelda E Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton

Figure 1 for Sparse MoEs meet Efficient Ensembles
Figure 2 for Sparse MoEs meet Efficient Ensembles
Figure 3 for Sparse MoEs meet Efficient Ensembles
Figure 4 for Sparse MoEs meet Efficient Ensembles
Viaarxiv icon

Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers

Sep 16, 2021
Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zack Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

Figure 1 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Figure 2 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Figure 3 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Figure 4 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Viaarxiv icon

Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning

Jun 07, 2021
Zachary Nado, Neil Band, Mark Collier, Josip Djolonga, Michael W. Dusenberry, Sebastian Farquhar, Angelos Filos, Marton Havasi, Rodolphe Jenatton, Ghassen Jerfel, Jeremiah Liu, Zelda Mariet, Jeremy Nixon, Shreyas Padhy, Jie Ren, Tim G. J. Rudner, Yeming Wen, Florian Wenzel, Kevin Murphy, D. Sculley, Balaji Lakshminarayanan, Jasper Snoek, Yarin Gal, Dustin Tran

Figure 1 for Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
Figure 2 for Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
Figure 3 for Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
Figure 4 for Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
Viaarxiv icon

Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems

Apr 23, 2021
Samuel Kim, Peter Y. Lu, Charlotte Loh, Jamie Smith, Jasper Snoek, Marin Soljačić

Figure 1 for Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems
Figure 2 for Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems
Figure 3 for Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems
Figure 4 for Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems
Viaarxiv icon