Alert button
Picture for Devang Naik

Devang Naik

Alert button

Weight subcloning: direct initialization of transformers using larger pretrained ones

Dec 14, 2023
Mohammad Samragh, Mehrdad Farajtabar, Sachin Mehta, Raviteja Vemulapalli, Fartash Faghri, Devang Naik, Oncel Tuzel, Mohammad Rastegari

Viaarxiv icon

eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models

Sep 13, 2023
Minsik Cho, Keivan A. Vahid, Qichen Fu, Saurabh Adya, Carlo C Del Mundo, Mohammad Rastegari, Devang Naik, Peter Zatloukal

Figure 1 for eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models
Figure 2 for eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models
Figure 3 for eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models
Figure 4 for eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models
Viaarxiv icon

Improving vision-inspired keyword spotting using dynamic module skipping in streaming conformer encoder

Aug 31, 2023
Alexandre Bittar, Paul Dixon, Mohammad Samragh, Kumari Nishu, Devang Naik

Figure 1 for Improving vision-inspired keyword spotting using dynamic module skipping in streaming conformer encoder
Figure 2 for Improving vision-inspired keyword spotting using dynamic module skipping in streaming conformer encoder
Viaarxiv icon

Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding

Aug 12, 2023
Kumari Nishu, Minsik Cho, Paul Dixon, Devang Naik

Figure 1 for Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding
Figure 2 for Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding
Figure 3 for Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding
Figure 4 for Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding
Viaarxiv icon

Matching Latent Encoding for Audio-Text based Keyword Spotting

Jun 08, 2023
Kumari Nishu, Minsik Cho, Devang Naik

Figure 1 for Matching Latent Encoding for Audio-Text based Keyword Spotting
Figure 2 for Matching Latent Encoding for Audio-Text based Keyword Spotting
Figure 3 for Matching Latent Encoding for Audio-Text based Keyword Spotting
Figure 4 for Matching Latent Encoding for Audio-Text based Keyword Spotting
Viaarxiv icon

PDP: Parameter-free Differentiable Pruning is All You Need

May 18, 2023
Minsik Cho, Saurabh Adya, Devang Naik

Figure 1 for PDP: Parameter-free Differentiable Pruning is All You Need
Figure 2 for PDP: Parameter-free Differentiable Pruning is All You Need
Figure 3 for PDP: Parameter-free Differentiable Pruning is All You Need
Figure 4 for PDP: Parameter-free Differentiable Pruning is All You Need
Viaarxiv icon

HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words

Oct 26, 2022
Arnav Kundu, Mohammad Samragh Razlighi, Minsik Cho, Priyanka Padmanabhan, Devang Naik

Figure 1 for HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words
Figure 2 for HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words
Figure 3 for HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words
Figure 4 for HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words
Viaarxiv icon

I see what you hear: a vision-inspired method to localize words

Oct 24, 2022
Mohammad Samragh, Arnav Kundu, Ting-Yao Hu, Minsik Cho, Aman Chadha, Ashish Shrivastava, Oncel Tuzel, Devang Naik

Figure 1 for I see what you hear: a vision-inspired method to localize words
Figure 2 for I see what you hear: a vision-inspired method to localize words
Figure 3 for I see what you hear: a vision-inspired method to localize words
Figure 4 for I see what you hear: a vision-inspired method to localize words
Viaarxiv icon

Optimize what matters: Training DNN-HMM Keyword Spotting Model Using End Metric

Nov 02, 2020
Ashish Shrivastava, Arnav Kundu, Chandra Dhir, Devang Naik, Oncel Tuzel

Figure 1 for Optimize what matters: Training DNN-HMM Keyword Spotting Model Using End Metric
Figure 2 for Optimize what matters: Training DNN-HMM Keyword Spotting Model Using End Metric
Figure 3 for Optimize what matters: Training DNN-HMM Keyword Spotting Model Using End Metric
Figure 4 for Optimize what matters: Training DNN-HMM Keyword Spotting Model Using End Metric
Viaarxiv icon