Alert button
Picture for Sanjiv Kumar

Sanjiv Kumar

Alert button

Google Research

Predicting on the Edge: Identifying Where a Larger Model Does Better

Feb 15, 2022
Taman Narayan, Heinrich Jiang, Sen Zhao, Sanjiv Kumar

Viaarxiv icon

Robust Training of Neural Networks using Scale Invariant Architectures

Feb 02, 2022
Zhiyuan Li, Srinadh Bhojanapalli, Manzil Zaheer, Sashank J. Reddi, Sanjiv Kumar

Figure 1 for Robust Training of Neural Networks using Scale Invariant Architectures
Figure 2 for Robust Training of Neural Networks using Scale Invariant Architectures
Figure 3 for Robust Training of Neural Networks using Scale Invariant Architectures
Figure 4 for Robust Training of Neural Networks using Scale Invariant Architectures
Viaarxiv icon

When in Doubt, Summon the Titans: Efficient Inference with Large Models

Oct 19, 2021
Ankit Singh Rawat, Manzil Zaheer, Aditya Krishna Menon, Amr Ahmed, Sanjiv Kumar

Figure 1 for When in Doubt, Summon the Titans: Efficient Inference with Large Models
Figure 2 for When in Doubt, Summon the Titans: Efficient Inference with Large Models
Figure 3 for When in Doubt, Summon the Titans: Efficient Inference with Large Models
Figure 4 for When in Doubt, Summon the Titans: Efficient Inference with Large Models
Viaarxiv icon

Leveraging redundancy in attention with Reuse Transformers

Oct 13, 2021
Srinadh Bhojanapalli, Ayan Chakrabarti, Andreas Veit, Michal Lukasik, Himanshu Jain, Frederick Liu, Yin-Wen Chang, Sanjiv Kumar

Figure 1 for Leveraging redundancy in attention with Reuse Transformers
Figure 2 for Leveraging redundancy in attention with Reuse Transformers
Figure 3 for Leveraging redundancy in attention with Reuse Transformers
Figure 4 for Leveraging redundancy in attention with Reuse Transformers
Viaarxiv icon

Batch Active Learning at Scale

Jul 29, 2021
Gui Citovsky, Giulia DeSalvo, Claudio Gentile, Lazaros Karydas, Anand Rajagopalan, Afshin Rostamizadeh, Sanjiv Kumar

Figure 1 for Batch Active Learning at Scale
Figure 2 for Batch Active Learning at Scale
Figure 3 for Batch Active Learning at Scale
Figure 4 for Batch Active Learning at Scale
Viaarxiv icon

Teacher's pet: understanding and mitigating biases in distillation

Jul 08, 2021
Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon, Sanjiv Kumar

Figure 1 for Teacher's pet: understanding and mitigating biases in distillation
Figure 2 for Teacher's pet: understanding and mitigating biases in distillation
Figure 3 for Teacher's pet: understanding and mitigating biases in distillation
Figure 4 for Teacher's pet: understanding and mitigating biases in distillation
Viaarxiv icon

Eigen Analysis of Self-Attention and its Reconstruction from Partial Computation

Jun 16, 2021
Srinadh Bhojanapalli, Ayan Chakrabarti, Himanshu Jain, Sanjiv Kumar, Michal Lukasik, Andreas Veit

Figure 1 for Eigen Analysis of Self-Attention and its Reconstruction from Partial Computation
Figure 2 for Eigen Analysis of Self-Attention and its Reconstruction from Partial Computation
Figure 3 for Eigen Analysis of Self-Attention and its Reconstruction from Partial Computation
Figure 4 for Eigen Analysis of Self-Attention and its Reconstruction from Partial Computation
Viaarxiv icon

Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets

May 25, 2021
Baris Sumengen, Anand Rajagopalan, Gui Citovsky, David Simcha, Olivier Bachem, Pradipta Mitra, Sam Blasiak, Mason Liang, Sanjiv Kumar

Figure 1 for Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets
Figure 2 for Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets
Figure 3 for Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets
Figure 4 for Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets
Viaarxiv icon

Balancing Robustness and Sensitivity using Feature Contrastive Learning

May 19, 2021
Seungyeon Kim, Daniel Glasner, Srikumar Ramalingam, Cho-Jui Hsieh, Kishore Papineni, Sanjiv Kumar

Figure 1 for Balancing Robustness and Sensitivity using Feature Contrastive Learning
Figure 2 for Balancing Robustness and Sensitivity using Feature Contrastive Learning
Figure 3 for Balancing Robustness and Sensitivity using Feature Contrastive Learning
Figure 4 for Balancing Robustness and Sensitivity using Feature Contrastive Learning
Viaarxiv icon