Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Designing Effective Sparse Expert Models



Barret Zoph , Irwan Bello , Sameer Kumar , Nan Du , Yanping Huang , Jeff Dean , Noam Shazeer , William Fedus

* 25 pages main text, 39 pages overall 

   Access Paper or Ask Questions

Revisiting 3D ResNets for Video Recognition



Xianzhi Du , Yeqing Li , Yin Cui , Rui Qian , Jing Li , Irwan Bello

* 6 pages 

   Access Paper or Ask Questions

Revisiting ResNets: Improved Training and Scaling Strategies



Irwan Bello , William Fedus , Xianzhi Du , Ekin D. Cubuk , Aravind Srinivas , Tsung-Yi Lin , Jonathon Shlens , Barret Zoph


   Access Paper or Ask Questions

LambdaNetworks: Modeling Long-Range Interactions Without Attention



Irwan Bello

* Accepted for publication at the International Conference in Learning Representations 2021 (Spotlight) 

   Access Paper or Ask Questions

Global Self-Attention Networks for Image Recognition



Zhuoran Shen , Irwan Bello , Raviteja Vemulapalli , Xuhui Jia , Ching-Hui Chen


   Access Paper or Ask Questions

Stand-Alone Self-Attention in Vision Models



Prajit Ramachandran , Niki Parmar , Ashish Vaswani , Irwan Bello , Anselm Levskaya , Jonathon Shlens


   Access Paper or Ask Questions

Attention Augmented Convolutional Networks



Irwan Bello , Barret Zoph , Ashish Vaswani , Jonathon Shlens , Quoc V. Le


   Access Paper or Ask Questions

Seq2Slate: Re-ranking and Slate Optimization with RNNs



Irwan Bello , Sayali Kulkarni , Sagar Jain , Craig Boutilier , Ed Chi , Elad Eban , Xiyang Luo , Alan Mackey , Ofer Meshi


   Access Paper or Ask Questions

Backprop Evolution



Maximilian Alber , Irwan Bello , Barret Zoph , Pieter-Jan Kindermans , Prajit Ramachandran , Quoc Le


   Access Paper or Ask Questions

1
2
>>