Alert button
Picture for Irwan Bello

Irwan Bello

Alert button

Designing Effective Sparse Expert Models

Feb 17, 2022
Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du, Yanping Huang, Jeff Dean, Noam Shazeer, William Fedus

Figure 1 for Designing Effective Sparse Expert Models
Figure 2 for Designing Effective Sparse Expert Models
Figure 3 for Designing Effective Sparse Expert Models
Figure 4 for Designing Effective Sparse Expert Models
Viaarxiv icon

Revisiting 3D ResNets for Video Recognition

Sep 03, 2021
Xianzhi Du, Yeqing Li, Yin Cui, Rui Qian, Jing Li, Irwan Bello

Figure 1 for Revisiting 3D ResNets for Video Recognition
Figure 2 for Revisiting 3D ResNets for Video Recognition
Figure 3 for Revisiting 3D ResNets for Video Recognition
Figure 4 for Revisiting 3D ResNets for Video Recognition
Viaarxiv icon

Revisiting ResNets: Improved Training and Scaling Strategies

Mar 13, 2021
Irwan Bello, William Fedus, Xianzhi Du, Ekin D. Cubuk, Aravind Srinivas, Tsung-Yi Lin, Jonathon Shlens, Barret Zoph

Figure 1 for Revisiting ResNets: Improved Training and Scaling Strategies
Figure 2 for Revisiting ResNets: Improved Training and Scaling Strategies
Figure 3 for Revisiting ResNets: Improved Training and Scaling Strategies
Figure 4 for Revisiting ResNets: Improved Training and Scaling Strategies
Viaarxiv icon

LambdaNetworks: Modeling Long-Range Interactions Without Attention

Feb 17, 2021
Irwan Bello

Figure 1 for LambdaNetworks: Modeling Long-Range Interactions Without Attention
Figure 2 for LambdaNetworks: Modeling Long-Range Interactions Without Attention
Figure 3 for LambdaNetworks: Modeling Long-Range Interactions Without Attention
Figure 4 for LambdaNetworks: Modeling Long-Range Interactions Without Attention
Viaarxiv icon

Global Self-Attention Networks for Image Recognition

Oct 14, 2020
Zhuoran Shen, Irwan Bello, Raviteja Vemulapalli, Xuhui Jia, Ching-Hui Chen

Figure 1 for Global Self-Attention Networks for Image Recognition
Figure 2 for Global Self-Attention Networks for Image Recognition
Figure 3 for Global Self-Attention Networks for Image Recognition
Figure 4 for Global Self-Attention Networks for Image Recognition
Viaarxiv icon

Stand-Alone Self-Attention in Vision Models

Jun 13, 2019
Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens

Figure 1 for Stand-Alone Self-Attention in Vision Models
Figure 2 for Stand-Alone Self-Attention in Vision Models
Figure 3 for Stand-Alone Self-Attention in Vision Models
Figure 4 for Stand-Alone Self-Attention in Vision Models
Viaarxiv icon

Attention Augmented Convolutional Networks

Apr 22, 2019
Irwan Bello, Barret Zoph, Ashish Vaswani, Jonathon Shlens, Quoc V. Le

Figure 1 for Attention Augmented Convolutional Networks
Figure 2 for Attention Augmented Convolutional Networks
Figure 3 for Attention Augmented Convolutional Networks
Figure 4 for Attention Augmented Convolutional Networks
Viaarxiv icon

Seq2Slate: Re-ranking and Slate Optimization with RNNs

Oct 04, 2018
Irwan Bello, Sayali Kulkarni, Sagar Jain, Craig Boutilier, Ed Chi, Elad Eban, Xiyang Luo, Alan Mackey, Ofer Meshi

Figure 1 for Seq2Slate: Re-ranking and Slate Optimization with RNNs
Figure 2 for Seq2Slate: Re-ranking and Slate Optimization with RNNs
Figure 3 for Seq2Slate: Re-ranking and Slate Optimization with RNNs
Figure 4 for Seq2Slate: Re-ranking and Slate Optimization with RNNs
Viaarxiv icon

Backprop Evolution

Aug 08, 2018
Maximilian Alber, Irwan Bello, Barret Zoph, Pieter-Jan Kindermans, Prajit Ramachandran, Quoc Le

Figure 1 for Backprop Evolution
Figure 2 for Backprop Evolution
Viaarxiv icon