Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel


Apr 21, 2023
Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Shen Li

Add code


   Access Paper or Ask Questions

PyTorch Distributed: Experiences on Accelerating Data Parallel Training


Jun 28, 2020
Shen Li, Yanli Zhao, Rohan Varma, Omkar Salpekar, Pieter Noordhuis, Teng Li, Adam Paszke, Jeff Smith, Brian Vaughan, Pritam Damania, Soumith Chintala

Add code

* To appear in VLDB 2020 

   Access Paper or Ask Questions

Vector-Valued Graph Trend Filtering with Non-Convex Penalties


May 29, 2019
Rohan Varma, Harlin Lee, Jelena Kovačević, Yuejie Chi

Add code

* The first two authors contributed equally. This paper has been submitted to the IEEE Transactions on Signal and Information Processing over Networks. A preliminary version of partial results in this paper was presented at 2019 IEEE ICASSP 

   Access Paper or Ask Questions

Sampling Theory for Graph Signals on Product Graphs


Sep 26, 2018
Rohan Varma, Jelena Kovačević

Add code

* Accepted to GlobalSIP 2018 

   Access Paper or Ask Questions

A statistical perspective of sampling scores for linear regression


Feb 10, 2016
Siheng Chen, Rohan Varma, Aarti Singh, Jelena Kovačević

Add code


   Access Paper or Ask Questions

Signal Representations on Graphs: Tools and Applications


Dec 16, 2015
Siheng Chen, Rohan Varma, Aarti Singh, Jelena Kovačević

Add code


   Access Paper or Ask Questions

Signal Recovery on Graphs: Random versus Experimentally Designed Sampling


May 29, 2015
Siheng Chen, Rohan Varma, Aarti Singh, Jelena Kovačević

Add code

* Correct some typos 

   Access Paper or Ask Questions