Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

$O(n)$ Connections are Expressive Enough: Universal Approximability of Sparse Transformers


Jun 08, 2020
Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

Add code

* 32 pages 

   Access Paper or Ask Questions

Why distillation helps: a statistical perspective


May 21, 2020
Aditya Krishna Menon, Ankit Singh Rawat, Sashank J. Reddi, Seungyeon Kim, Sanjiv Kumar

Add code


   Access Paper or Ask Questions

Doubly-stochastic mining for heterogeneous retrieval


Apr 23, 2020
Ankit Singh Rawat, Aditya Krishna Menon, Andreas Veit, Felix Yu, Sashank J. Reddi, Sanjiv Kumar

Add code


   Access Paper or Ask Questions

Federated Learning with Only Positive Labels


Apr 21, 2020
Felix X. Yu, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar

Add code


   Access Paper or Ask Questions

Robust Large-Margin Learning in Hyperbolic Space


Apr 11, 2020
Melanie Weber, Manzil Zaheer, Ankit Singh Rawat, Aditya Menon, Sanjiv Kumar

Add code

* Under Review 

   Access Paper or Ask Questions

Reliable Distributed Clustering with Redundant Data Assignment


Feb 20, 2020
Venkata Gandikota, Arya Mazumdar, Ankit Singh Rawat

Add code


   Access Paper or Ask Questions

Low-Rank Bottleneck in Multi-head Attention Models


Feb 17, 2020
Srinadh Bhojanapalli, Chulhee Yun, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

Add code

* 17 pages, 4 figures 

   Access Paper or Ask Questions

Are Transformers universal approximators of sequence-to-sequence functions?


Dec 20, 2019
Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

Add code

* Accepted to ICLR 2020 

   Access Paper or Ask Questions

Sampled Softmax with Random Fourier Features


Jul 24, 2019
Ankit Singh Rawat, Jiecao Chen, Felix Yu, Ananda Theertha Suresh, Sanjiv Kumar

Add code


   Access Paper or Ask Questions

Lifting high-dimensional nonlinear models with Gaussian regressors


Oct 26, 2018
Christos Thrampoulidis, Ankit Singh Rawat

Add code

* Improved the algorithm and expanded on its motivation; added simulation results 

   Access Paper or Ask Questions

<<
1
2
3
4
>>