Picture for Srinadh Bhojanapalli

Srinadh Bhojanapalli

Depth Dependence of $μ$P Learning Rates in ReLU MLPs

May 13, 2023
Samy Jelassi, Boris Hanin, Ziwei Ji, Sashank J. Reddi, Srinadh Bhojanapalli, Sanjiv Kumar

Access Paper or Ask Questions

On the Adversarial Robustness of Mixture of Experts

Oct 19, 2022
Joan Puigcerver, Rodolphe Jenatton, Carlos Riquelme, Pranjal Awasthi, Srinadh Bhojanapalli

Figure 1 for On the Adversarial Robustness of Mixture of Experts

Figure 2 for On the Adversarial Robustness of Mixture of Experts

Figure 3 for On the Adversarial Robustness of Mixture of Experts

Figure 4 for On the Adversarial Robustness of Mixture of Experts

* Accepted to NeurIPS 2022

Access Paper or Ask Questions

Treeformer: Dense Gradient Trees for Efficient Attention Computation

Aug 18, 2022
Lovish Madaan, Srinadh Bhojanapalli, Himanshu Jain, Prateek Jain

Figure 1 for Treeformer: Dense Gradient Trees for Efficient Attention Computation

Figure 2 for Treeformer: Dense Gradient Trees for Efficient Attention Computation

Figure 3 for Treeformer: Dense Gradient Trees for Efficient Attention Computation

Figure 4 for Treeformer: Dense Gradient Trees for Efficient Attention Computation

* Preprint. Under Review

Access Paper or Ask Questions

Robust Training of Neural Networks using Scale Invariant Architectures

Feb 02, 2022
Zhiyuan Li, Srinadh Bhojanapalli, Manzil Zaheer, Sashank J. Reddi, Sanjiv Kumar

Figure 1 for Robust Training of Neural Networks using Scale Invariant Architectures

Figure 2 for Robust Training of Neural Networks using Scale Invariant Architectures

Figure 3 for Robust Training of Neural Networks using Scale Invariant Architectures

Figure 4 for Robust Training of Neural Networks using Scale Invariant Architectures

* 36 pages, 7 figures

Access Paper or Ask Questions

Teacher's pet: understanding and mitigating biases in distillation

Jul 08, 2021
Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon, Sanjiv Kumar

Figure 1 for Teacher's pet: understanding and mitigating biases in distillation

Figure 2 for Teacher's pet: understanding and mitigating biases in distillation

Figure 3 for Teacher's pet: understanding and mitigating biases in distillation

Figure 4 for Teacher's pet: understanding and mitigating biases in distillation

* 21 pages, 8 figures

Access Paper or Ask Questions