Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Ankit Singh Rawat

When in Doubt, Summon the Titans: Efficient Inference with Large Models


Oct 19, 2021
Ankit Singh Rawat, Manzil Zaheer, Aditya Krishna Menon, Amr Ahmed, Sanjiv Kumar


  Access Paper or Ask Questions

Disentangling Sampling and Labeling Bias for Learning in Large-Output Spaces


May 12, 2021
Ankit Singh Rawat, Aditya Krishna Menon, Wittawat Jitkrittum, Sadeep Jayasumana, Felix X. Yu, Sashank Reddi, Sanjiv Kumar

* To appear in ICML 2021 

  Access Paper or Ask Questions

Distilling Double Descent


Feb 13, 2021
Andrew Cotter, Aditya Krishna Menon, Harikrishna Narasimhan, Ankit Singh Rawat, Sashank J. Reddi, Yichen Zhou


  Access Paper or Ask Questions

On the Reproducibility of Neural Network Predictions


Feb 05, 2021
Srinadh Bhojanapalli, Kimberly Wilber, Andreas Veit, Ankit Singh Rawat, Seungyeon Kim, Aditya Menon, Sanjiv Kumar

* 19 pages, 7 figures 

  Access Paper or Ask Questions

Modifying Memories in Transformer Models


Dec 01, 2020
Chen Zhu, Ankit Singh Rawat, Manzil Zaheer, Srinadh Bhojanapalli, Daliang Li, Felix Yu, Sanjiv Kumar


  Access Paper or Ask Questions

Adversarial robustness via robust low rank representations


Aug 01, 2020
Pranjal Awasthi, Himanshu Jain, Ankit Singh Rawat, Aravindan Vijayaraghavan

* fixed a bug in the proof of Proposition B.2 

  Access Paper or Ask Questions

Long-tail learning via logit adjustment


Jul 14, 2020
Aditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain, Andreas Veit, Sanjiv Kumar


  Access Paper or Ask Questions

$O(n)$ Connections are Expressive Enough: Universal Approximability of Sparse Transformers


Jun 08, 2020
Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

* 32 pages 

  Access Paper or Ask Questions

Why distillation helps: a statistical perspective


May 21, 2020
Aditya Krishna Menon, Ankit Singh Rawat, Sashank J. Reddi, Seungyeon Kim, Sanjiv Kumar


  Access Paper or Ask Questions

Doubly-stochastic mining for heterogeneous retrieval


Apr 23, 2020
Ankit Singh Rawat, Aditya Krishna Menon, Andreas Veit, Felix Yu, Sashank J. Reddi, Sanjiv Kumar


  Access Paper or Ask Questions

Federated Learning with Only Positive Labels


Apr 21, 2020
Felix X. Yu, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar


  Access Paper or Ask Questions

Robust Large-Margin Learning in Hyperbolic Space


Apr 11, 2020
Melanie Weber, Manzil Zaheer, Ankit Singh Rawat, Aditya Menon, Sanjiv Kumar

* Under Review 

  Access Paper or Ask Questions

Reliable Distributed Clustering with Redundant Data Assignment


Feb 20, 2020
Venkata Gandikota, Arya Mazumdar, Ankit Singh Rawat


  Access Paper or Ask Questions

Low-Rank Bottleneck in Multi-head Attention Models


Feb 17, 2020
Srinadh Bhojanapalli, Chulhee Yun, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

* 17 pages, 4 figures 

  Access Paper or Ask Questions

Are Transformers universal approximators of sequence-to-sequence functions?


Dec 20, 2019
Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

* Accepted to ICLR 2020 

  Access Paper or Ask Questions

Sampled Softmax with Random Fourier Features


Jul 24, 2019
Ankit Singh Rawat, Jiecao Chen, Felix Yu, Ananda Theertha Suresh, Sanjiv Kumar


  Access Paper or Ask Questions

Lifting high-dimensional nonlinear models with Gaussian regressors


Oct 26, 2018
Christos Thrampoulidis, Ankit Singh Rawat

* Improved the algorithm and expanded on its motivation; added simulation results 

  Access Paper or Ask Questions

Robust Gradient Descent via Moment Encoding with LDPC Codes


May 22, 2018
Raj Kumar Maity, Ankit Singh Rawat, Arya Mazumdar


  Access Paper or Ask Questions

Representation Learning and Recovery in the ReLU Model


Mar 12, 2018
Arya Mazumdar, Ankit Singh Rawat


  Access Paper or Ask Questions

Associative Memory using Dictionary Learning and Expander Decoding


Nov 29, 2016
Arya Mazumdar, Ankit Singh Rawat

* To appear in AAAI 2017 

  Access Paper or Ask Questions