Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Prajit Ramachandran

Scaling Local Self-Attention for Parameter Efficient Visual Backbones

Mar 30, 2021
Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake Hechtman, Jonathon Shlens

* CVPR 2021 Oral 

  Access Paper or Ask Questions

Revisiting Fundamentals of Experience Replay

Jul 13, 2020
William Fedus, Prajit Ramachandran, Rishabh Agarwal, Yoshua Bengio, Hugo Larochelle, Mark Rowland, Will Dabney

* Published at ICML 2020. First two authors contributed equally and code available at 

  Access Paper or Ask Questions

Revisiting Spatial Invariance with Low-Rank Local Connectivity

Feb 07, 2020
Gamaleldin F. Elsayed, Prajit Ramachandran, Jonathon Shlens, Simon Kornblith

  Access Paper or Ask Questions

Stand-Alone Self-Attention in Vision Models

Jun 13, 2019
Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens

  Access Paper or Ask Questions

Backprop Evolution

Aug 08, 2018
Maximilian Alber, Irwan Bello, Barret Zoph, Pieter-Jan Kindermans, Prajit Ramachandran, Quoc Le

  Access Paper or Ask Questions

Unsupervised Pretraining for Sequence to Sequence Learning

Feb 22, 2018
Prajit Ramachandran, Peter J. Liu, Quoc V. Le

* Updated to accepted EMNLP 2017 version 

  Access Paper or Ask Questions

Searching for Activation Functions

Oct 27, 2017
Prajit Ramachandran, Barret Zoph, Quoc V. Le

* Updated version of "Swish: a Self-Gated Activation Function" 

  Access Paper or Ask Questions

Fast Generation for Convolutional Autoregressive Models

Apr 20, 2017
Prajit Ramachandran, Tom Le Paine, Pooya Khorrami, Mohammad Babaeizadeh, Shiyu Chang, Yang Zhang, Mark A. Hasegawa-Johnson, Roy H. Campbell, Thomas S. Huang

* Accepted at ICLR 2017 Workshop 

  Access Paper or Ask Questions

Stein Variational Policy Gradient

Apr 07, 2017
Yang Liu, Prajit Ramachandran, Qiang Liu, Jian Peng

  Access Paper or Ask Questions

Fast Wavenet Generation Algorithm

Nov 29, 2016
Tom Le Paine, Pooya Khorrami, Shiyu Chang, Yang Zhang, Prajit Ramachandran, Mark A. Hasegawa-Johnson, Thomas S. Huang

* Technical Report 

  Access Paper or Ask Questions

Seq-NMS for Video Object Detection

Aug 22, 2016
Wei Han, Pooya Khorrami, Tom Le Paine, Prajit Ramachandran, Mohammad Babaeizadeh, Honghui Shi, Jianan Li, Shuicheng Yan, Thomas S. Huang

* Technical Report for Imagenet VID Competition 2015 

  Access Paper or Ask Questions