Alert button
Picture for Prajit Ramachandran

Prajit Ramachandran

Alert button

Scaling Local Self-Attention for Parameter Efficient Visual Backbones

Mar 30, 2021
Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake Hechtman, Jonathon Shlens

Figure 1 for Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Figure 2 for Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Figure 3 for Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Figure 4 for Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Viaarxiv icon

Revisiting Fundamentals of Experience Replay

Jul 13, 2020
William Fedus, Prajit Ramachandran, Rishabh Agarwal, Yoshua Bengio, Hugo Larochelle, Mark Rowland, Will Dabney

Figure 1 for Revisiting Fundamentals of Experience Replay
Figure 2 for Revisiting Fundamentals of Experience Replay
Figure 3 for Revisiting Fundamentals of Experience Replay
Figure 4 for Revisiting Fundamentals of Experience Replay
Viaarxiv icon

Revisiting Spatial Invariance with Low-Rank Local Connectivity

Feb 07, 2020
Gamaleldin F. Elsayed, Prajit Ramachandran, Jonathon Shlens, Simon Kornblith

Figure 1 for Revisiting Spatial Invariance with Low-Rank Local Connectivity
Figure 2 for Revisiting Spatial Invariance with Low-Rank Local Connectivity
Figure 3 for Revisiting Spatial Invariance with Low-Rank Local Connectivity
Figure 4 for Revisiting Spatial Invariance with Low-Rank Local Connectivity
Viaarxiv icon

Stand-Alone Self-Attention in Vision Models

Jun 13, 2019
Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens

Figure 1 for Stand-Alone Self-Attention in Vision Models
Figure 2 for Stand-Alone Self-Attention in Vision Models
Figure 3 for Stand-Alone Self-Attention in Vision Models
Figure 4 for Stand-Alone Self-Attention in Vision Models
Viaarxiv icon

Backprop Evolution

Aug 08, 2018
Maximilian Alber, Irwan Bello, Barret Zoph, Pieter-Jan Kindermans, Prajit Ramachandran, Quoc Le

Figure 1 for Backprop Evolution
Figure 2 for Backprop Evolution
Viaarxiv icon

Unsupervised Pretraining for Sequence to Sequence Learning

Feb 22, 2018
Prajit Ramachandran, Peter J. Liu, Quoc V. Le

Figure 1 for Unsupervised Pretraining for Sequence to Sequence Learning
Figure 2 for Unsupervised Pretraining for Sequence to Sequence Learning
Figure 3 for Unsupervised Pretraining for Sequence to Sequence Learning
Figure 4 for Unsupervised Pretraining for Sequence to Sequence Learning
Viaarxiv icon

Searching for Activation Functions

Oct 27, 2017
Prajit Ramachandran, Barret Zoph, Quoc V. Le

Figure 1 for Searching for Activation Functions
Figure 2 for Searching for Activation Functions
Figure 3 for Searching for Activation Functions
Figure 4 for Searching for Activation Functions
Viaarxiv icon

Fast Generation for Convolutional Autoregressive Models

Apr 20, 2017
Prajit Ramachandran, Tom Le Paine, Pooya Khorrami, Mohammad Babaeizadeh, Shiyu Chang, Yang Zhang, Mark A. Hasegawa-Johnson, Roy H. Campbell, Thomas S. Huang

Figure 1 for Fast Generation for Convolutional Autoregressive Models
Figure 2 for Fast Generation for Convolutional Autoregressive Models
Figure 3 for Fast Generation for Convolutional Autoregressive Models
Figure 4 for Fast Generation for Convolutional Autoregressive Models
Viaarxiv icon

Stein Variational Policy Gradient

Apr 07, 2017
Yang Liu, Prajit Ramachandran, Qiang Liu, Jian Peng

Figure 1 for Stein Variational Policy Gradient
Figure 2 for Stein Variational Policy Gradient
Figure 3 for Stein Variational Policy Gradient
Figure 4 for Stein Variational Policy Gradient
Viaarxiv icon

Fast Wavenet Generation Algorithm

Nov 29, 2016
Tom Le Paine, Pooya Khorrami, Shiyu Chang, Yang Zhang, Prajit Ramachandran, Mark A. Hasegawa-Johnson, Thomas S. Huang

Figure 1 for Fast Wavenet Generation Algorithm
Figure 2 for Fast Wavenet Generation Algorithm
Figure 3 for Fast Wavenet Generation Algorithm
Figure 4 for Fast Wavenet Generation Algorithm
Viaarxiv icon