Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Vivek Ramanujan

Parameter Norm Growth During Training of Transformers


Nov 11, 2020
William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah Smith

* Preprint. 9 body pages with appendix 

  Access Paper or Ask Questions

Supermasks in Superposition


Jun 30, 2020
Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Aniruddha Kembhavi, Mohammad Rastegari, Jason Yosinski, Ali Farhadi


  Access Paper or Ask Questions

Soft Threshold Weight Reparameterization for Learnable Sparsity


Mar 11, 2020
Aditya Kusupati, Vivek Ramanujan, Raghav Somani, Mitchell Wortsman, Prateek Jain, Sham Kakade, Ali Farhadi

* 17 pages, 9 figures 

  Access Paper or Ask Questions

What's Hidden in a Randomly Weighted Neural Network?


Nov 29, 2019
Vivek Ramanujan, Mitchell Wortsman, Aniruddha Kembhavi, Ali Farhadi, Mohammad Rastegari


  Access Paper or Ask Questions

Improving Shape Deformation in Unsupervised Image-to-Image Translation


Aug 13, 2018
Aaron Gokaslan, Vivek Ramanujan, Daniel Ritchie, Kwang In Kim, James Tompkin


  Access Paper or Ask Questions