Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Vivek Ramanujan

Parameter Norm Growth During Training of Transformers

Nov 11, 2020
William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah Smith

* Preprint. 9 body pages with appendix 

  Access Paper or Ask Questions

Supermasks in Superposition

Jun 30, 2020
Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Aniruddha Kembhavi, Mohammad Rastegari, Jason Yosinski, Ali Farhadi

  Access Paper or Ask Questions

Soft Threshold Weight Reparameterization for Learnable Sparsity

Mar 11, 2020
Aditya Kusupati, Vivek Ramanujan, Raghav Somani, Mitchell Wortsman, Prateek Jain, Sham Kakade, Ali Farhadi

* 17 pages, 9 figures 

  Access Paper or Ask Questions

What's Hidden in a Randomly Weighted Neural Network?

Nov 29, 2019
Vivek Ramanujan, Mitchell Wortsman, Aniruddha Kembhavi, Ali Farhadi, Mohammad Rastegari

  Access Paper or Ask Questions

Improving Shape Deformation in Unsupervised Image-to-Image Translation

Aug 13, 2018
Aaron Gokaslan, Vivek Ramanujan, Daniel Ritchie, Kwang In Kim, James Tompkin

  Access Paper or Ask Questions